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INTRODUCTION 



This ECS working paper is a compilation of articles prepared for the Policy and the 
Higher Literacies Project. The two-year project, funded by the John D. and Catherine T. 
MacArthur Foundation, examines key leverage points in state and local education policy 
levels and how they may promote or constrict the acquisition of much higher levels of 
literacy for a much broader range of American students. Our research strongly suggests 
a mismatch between stated goals of the American education system and current practice 
and outcomes. The articles in this paper discuss this apparent mismatch and call for 
thoughtful reappraisals. 
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i he Common Agenda: 
Liberating Undreamed-of Talent 



by Governor William Clinton 



America is in need of a much more pro- 
ductive economy and education system. 
We must restructure schools and cultivate 
the kinds of leadership appropriate to an 
era of rapid change. 



More than two centuries ago, Thomas Jeffer- 
son argued that vast potential for genius and 
leadership lay untapped throughout the world. 
He called for a more general diffusion of knowl- 
edge across Virginia and the other colonies in 
order to create "an aristocracy of virtue and tal- 
ent" that would lead the country through its 
great experiment with democracy. 

Then, education was necessary to create an 
America of our founders' vision. Now, educa- 
tion is necessary to sustain the America which 
emerged from that vision, an America capable 
of providing opportunity at home and preserv- 
ing peace and promoting prosperity around the 
world. Whether we can meet that challenge is 
open to question. 

Formidable internal and external challenges 
to our prosperity and position in the world force 
upon us a common agenda: to unleash the unde- 
veloped, even undreamed-of talents of our people. 

As in Jefferson's time, this nation again must 
recognize that the source of its greatness is its 
people, and its mission is constantly to find new 
ways to tap the boundless creative and produc- 
tive energies of common men and women. 

Business, educational and governmental insti- 
tutions sufficient to meet the needs of the mid- 
20th Century are no longer sufficient to meet 
the challenges of the 21st. Low-wage workers 
with very basic skills and minimal competencies 
are available in many parts of the world. They 
are highly motivated, eager to work for wages 
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Americans cannot live on. If comparative labor 
costs are the determining factor in our competi- 
tive position, we are bound to fail. 

This nation either must work toward some sort 
of high-wage, high-technology, innovative econ- 
omy or ask each succeeding generation to accept 
a lower standard of living. This process, in fact, 
began in 1973, when real median income started 
to decline. Although 9.3 million new jobs were 
created between 1979 and 1985, 44 percent were 
at or below the poverty level, twice the percen- 
tage of poverty jobs created in the previous six- 
year period. Between 1981 and 1986, four out 
of 10 Americans experienced a decline in their 
real income. This drift cannot be allowed to con- 
tinue. The only way to *top it is by increasing 
the efficiency by which we do old things or by 
finding new things to do which are not yet sub- 
ject to undercutting by overseas competitors. 

Higher Literacies 

If business is going to create more appropriate 
jobs, the people must be there to fill them. A 
Public Opinion Laboratory study found Ameri- 
cans to be "scientifically illiterate" and most to 
be only minimally conversant with basic scien- 
tific facts, ideas and processes. Recent compari- 
sons of American students' mathematics achieve- 
ment to x at of students in other countries are 
equally dismaying. So, clearly, schools will need 
to enable a much larger segment of the popula- 
tion to acquire comprehensive understandings 
of science, mathematics and technology. Even 
those citizens who have no interest in being tech- 
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nical workers will have to understand complex 
technical and scientific issues to make respon- 
sive public policy and the kinds of judgments our 
democracy requires of its citizens today. 

A high technology, high-wage economy calls 
for more than improved mathematics and science 
achievement; ii, calls for much higher levels of 
general literacy, more inquiry skills and more 
widespread sophistication in reasoning, analyzing 
and interpreting information. An advanced eco- 
nomy will demand more creativity, more mental 
flexibility, and more capacity to aclapt to rapidly 
changing work demands and job structures. 

Unfortunately, there have been steady declines 
in the proportion of students demonstrating higher 
literacy skills such as analytical writing, prob- 
lem solving, critical thinking, argument, anal- 
ysis, synthesis, interpretation and evaluation. 
Most recent reports from the National Assess- 
ment of Educational Progress make it clear that 
although most U.S. students easily meet the 
lower literacy standards of a generation ago, a 
majority do not meet today's higher standards 
and are unlikely to meet tomorrow's. Not only 
have few students been exhibiting higher liter- 
acy skills and habits, researchers also paint a 
gloomy picture of most schools' capacity to turn 
the trend around. 



A high technology, high-wage economy calls for 
more than improved mathematics and science 
achievement; it calls for much higher levels of 
general literacy, more inquiry skills and more 
widespread sophistication in reasoning, analyzing 
and interpreting information. 



In his comprehensive study of schooling, John 
Goodlad found that very few classrooms are con- 
ducive to training in and practice of higher-order 
thinking skills. Teachers monopolize classroom 
discussion, out-talking entire classrooms of stu- 
dents by a large ratio. Extended discussion, writ- 
ing and rewriting, debate and all of tire ways in 
which students might develop more sophisticated 
information processing skills are simply not pres- 
ent in many classrooms. And Goodlad found that 
even teachers who want to cultivate such skills 
in their students either do not know how or find 
themselves constrained by the structural condi- 
tions of teaching and schooling. 

Paramount among these conditions is the need 
to control large numbers of restless students in 
a small space. Other conditions conspire with 
this management problem to make it difficult 
for teachers to try innovative programs, spend 
more than a few minutes on any task, or attend 



to individual needs that require writing or re- 
duce their dependence on the lecture. Teachers' 
many noneducational duties absorb time des- 
perately needed for planning complex learning 
activities and collaboration with colleagues 
about how the school should be run to achieve 
its mission. A grasp of how different subjects 
relate to each other— how mathematics relates 
to science, for instance, or how both relate to 
history— is out of the question. 

Emphasis on Basics 

Most troubling, Goodlad found that to the ex- 
tent that training in higher-thinking skills ap- 
peared anywhere, it appeared in the courses re- 
served for the college-bound student. Students 
in general education, vocational education or in 
low-track courses were being instructed in the 
basics, very fundamentally defined. These stu- 
dents, disproportionately minorities and disad- 
vantaged children, at risk in many social and 
educational ways, are subjected to the drill, prac- 
tice and rote kinds of learning that do not lead 
to creativity or to any capacity to interpret, ana- 
lyze, synthesis or solve problems. They are be- 
ing trained with an industrial model of literacy 
that will not serve them well in the years ahead 
in schools that themselves are organized along 
rigid hierarchical old-fashioned lines. 

Like the international challenge, this national 
challenge is not one we can shirk. Schools are 
simply going to have to do a much better job of 
educating students whose backgrounds do not pre- 
pare them to be successful students. Instead of 
weeding them out or doing them in with watered- 
down courses, schools will have to find new ways 
to develop their latent talents. Not to address 
this problem is to acquiesce in the crippling of a 
large proportion of young people, to drift toward 
a two-tiered society which has been developing 
more rapidly in the past five years and to invite 
a continued increase in the gap between rich and 
poor in this society. 

Second Reform Wave 

To meet the challenge before us, education 
must go through a second wave of reform which 
goes to the heart of the learning process, focus- 
ing on how schools are run, how teachers teach, 
what students do and what the state requires 
in the way of regulation, paperwork, etc. To cap- 
ture the essence of what now needs to be done, 
education has borrowed a buzz word from cor- 
porate America: restructuring. 

In education or in business, restructuring may 
take on different meanings from school to school, 
but everywhere it means vastly improving pro- 
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ductivity so that more students stay in school 
and have much more of what they need to know. 
It means changes in the system of instruction, 
better use of time, creating an atmosphere more 
conducive to learning, integrating technology more 
efficiently and leading schools more effectively. 
It means shared decision making at the school 
level, less bureaucracy and more effective alli- 
ances with business and community agencies 
and with health, welfare and juvenile justice 
programs. 

State policy needs restructuring as well. For 
decades, policymakers have focused their atten- 
tion upon minimum standards. That is their duty: 
to assure the public that its tax-supported insti- 
tutions are functioning (airly and efficiency. 

But there are limits to what we can accomplish 
v/ith minimums-oriented policies, and their effect 
upon teachers and administrators may some- 
times be to prevent excellence as well as to man- 
date minimum performance. If state policy for 
funding programs and certifying teachers dis- 
courages innovation, we will not get the experi- 
mentation we S9 desperately need. State leaders 
have to find policy tools that inspire, rather than 
deaden, educators; that forge links, rather than 
create educational fiefdoms; that empower people, 
rather than enslave them to bureaucratic rou- 
tine and paperwork. 



Changing Obstacles 

There are, of course, many obstacles to these 
kinds of change. State ag. -cy and local admin- 
istrative control patterns are deeply entrenched 
and there is great, often justified, fear that too 
much deregulation could lead to falling mini- 
mums rather than rising maximums. The system 
of selecting, training, evaluating and rewarding 
school leaders seldom encourages both competi- 
tion and innovation. Entrenched bureaucracies 
from teacher colleges to administrator groups to 
teacher unions often fight harder for their turf 
and their retirement benefits than for more flex- 
ible, open, efficient ways of educating children. 
A powerful inertia grips the system. Many within 
it have tired of state mandates piled on the already 
considerable burden of their jobs and hava de- 
cided to "wait this one out" as they have waited 
out reforms in the past. 

One can try to change a complex system like 
this through outside pressure and influence, but 
without the support of people inside the system, 
not much will happen. On the other hand, people 
inside the system will never change it radically 
without the help of policymakers, community 
leaders, business leaders and others outside the 



system. The key to success in the next stage of 
reform is to get people inside and outside the 
system to work in tandem. 



To meet the challenge before us, education must 
go through a second wave of reform which goes 
to the heart of the learning process, focusing on 
how schools are run, how teachers teach, what 
students do and what the state requires in the 
way of regulation, paperwork, etc. To capture 
the essence of what now needs to be done, 
education has borrowed a buzz word from 
corporate America: restructuring. 



If we are going to tap the vast untapped poten- 
tial of our workers and our students, it is going 
to require new kinds of leadership up and down 
the line. The leadership we need recognizes the 
permanence of change; the primary importance 
of people over all other resources; the necessity 
of reaching out to build communities of purpose 
within the schools and with business and other 
allies beyond the schools; and the imperative 
to restructure the schools as many businesses 
have, in order to place responsibility where is 
belongs, so that people closest to the problems 
have the responsibility to solve them. 

If we want to keep the American dream alive 
for our own people and preserve America's role 
in the world, we must develop an excellent, con- 
tinuously changing system for educating and 
training our people. We have to bring down the 
barriers to productivity that keep too many people 
out of the mainstream at a time when we need 
all of our people to be as productive as possible. 

When the 21st Century rolls around, we are 
either going to look back on this period and say 
this was a very difficult time for America, but 
we met the challeng3, preserved our role in the 
world and renewed our progress toward prosper- 
ity and peace. Or we will say that we failed, our 
time passed, and world political and economic 
leadership passed on to those who were willing 
to do what we could have done, but chose not to 
do. 

The rest of the world is watching to see whether 
Jefferson was right. Can our highly diverse, de- 
centralized democracy develop enough of our 
human potential to meet the test we face? That 
is the question we will answer. The right answer 
is not easy, quick or inexpensive. But if we re- 
affirm the vision of Jefferson, we can preserve 
the American dream for another generation of 
Americans.3 
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Policy Constraints to the 
Teaching of Thinking 



by Robert J. Marzano 



Various policy barriers can slow down 
change. Unless policymakers and educators 
take a broader view of curriculum and 
assessment, and unless school leaders 
stand up to single interest groups, there 
will be little movement toward better in- 
struction in thinking. 



Agreement is spreading nationally that direct 
instruction in higher-order thinking skills should 
be a major educational focus. The need for teaching 
thinking has been highlighted by such prominent 
education organizations as the College Board, 1 
the Education Commission of the States, 2 the 
American Federation of Teachers and the Asso- 
ciation for Supervision and Curriculum Develop* 
ment. 

Concern for the teaching of thinking also is re- 
flected locally. For example, the desire to learn 
strategies and techniques for the teaching of think- 
ing consistently shows up at the top of the list 
on surveys of teachers preferences for inservice 
training. 

To meet this demand, researchers and educa- 
tors have developed a number of programs. For 
example, Arthur Costa 3 identified more than 
30 approaches currently proposed for the teach- 
ing of thinking. Given the widespread interest 
in teaching thinking, and the growing number 
of programs to satisfy that interest, one would 
assume that classroom instruction in thinking 
would be increasingly rapidly. However, this 
is not the case. Rather, the implementation of 
thinking-skills programs appears to be a slow 
and laborious process with many hurdles to over- 
come if it is to be more than just another "frill" 
as Carl Bereiter 4 has suggested. 



Dr. Marzano is the Director of Research for the Mid* 
Continent Regional Educational Laboratory. 



A number of barriers to the implementation 
of thinking-skills instruction exist— barriers 
that can and should be addressed in education 
policies. They include: (1) a narrow view of cur- 
riculum, (2) an equally narrow view of assess- 
ment and (3) involvement of noneducator groups 
in pedagogical decisions. 

A Narrow View of Curriculum 

Barbara Presseisen 5 noted that the most com- 
mon curricular debate is over which content should 
be covered— what factual subject matter is essen- 
tial for students to learn. Unfortunately, an em- 
phasis on teaching factual information is not 
consistent with the changing nature of society 
and the effects of that change on the types of 
knowledge students must possess for success in 
the "marketplace." 6 Specifically, the student of 
tomorrow (and, indeed, today) must possess not 
only factual knowledge but also a broad range 
of metacognitive and cognitive strate//ies to pro- 
cess and utilize factual information. 

Metacognitive strategies provide learners with 
an awareness and control of the task. This in- 
volves such factors as having a clear goal or sub- 
goal, monitoring progress toward that goal, cor- 
recting for ineffective behavior, identifying al- 
ternative cognitive strategies and selecting the 
most effective strategy. While reading, students 
might ask themselves "What is my purpose? Am 
I reading for detail or to get the gist of the in- 
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formation?" Answers to these and similar ques- 
tions would identify appropriate cognitive strat- 
egies. (If reading for detail students might con- 
sider underlining or using a colored pen to high- 
light important facts, for example.) 

After selecting the strategy best suited for the 
task, readers would occasionally remind them- 
selves of the goal and assess the effectiveness 
of their actions ("Should I pick up my pace since 
I only have an hour to do this?") When the task 
was completed, readers would again assess then- 
strategies, identifying learning tactics that might 
be altered or dropped in the future. 

Metacognition also involves knowledge and 
control of self. Here learners monitor such things 
as f heir level of attention and engagement and 
their attitudes. For example, if students recog 
nize that their attention were waning, they might 
examine their attitudes about the task. Nega- 
tive attitudes beget ineffective behavior; positive 
attitudes provide a climate in which effective 
behavior can occur. The students would attempt 
to replace negative attitudes with more positive 
ones. For example, if the learners thought the 
task had little value, they might consciously 
look for something worthwhile in it. If they be- 
lieved they could not perform the task, they would 
engage in more positive "self-talk," asserting 
that they could do the task. 

According to Barbara McCombs, 7 the teach- 
ing of metacognitive strategies can be an edu- 
cational breakthrough, providing for some stu- 
dents a vehicle to unlock the previously closed 
door to learning. Equally as important is direct 
instruction in cognitive strategies. 

These involve: (1) factual or declarative knowl- 
edge, (2) process or procedural knowledge and 
(3) conditional knowledge— when and why a pi o- 
cess should be used. Cognitive strategies are 
fairly specific to a given task. Students working 
on a mathematics problem, for example, would 
need to know certain facts relative to tLo prob- 
lem—a specific formula, the relationship between 
certain principles. They would also need to know 
specific problem-solving procedures, such as work- 
ing backwards from the answer or breaking the 
problem into smaller component parts. Finally, 
the students would need to know when a given 
procedure was appropriate to use and when it 
was not. 

Recent research 8 indicates that rarely, if at 
all, do schools provide students with direct in- 
struction in the cognitive or metacognitive stra- 
tegies necessary to perform academic tasks. Yet 
such instruction can drastically improve student 
performance. Instead, content instruction is per- 
meated by an emphasis on factual information. 
To shift this trend would require a reconceptual- 
ization of the curriculum. At its core this is a 
policy issue. As long as central administrators 
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within school districts and curriculum special- 
ists at the local, state and national levels con- 
ceive of curriculum as a list of discrete, content- 
apecific, factual objectives, there is little chance 
that thinking-skills instruction will become a 
central part of classroom instruction. 

A curriculum that includes the teaching of think- 
ing would necessarily have a balance among fac- 
tual content, metacognitive and cognitive objec- 
tives. Eecause most schools and districts already 
have an overwhelming number of objectives de- 
voted to factual content, the incorporation of 
thinking-skills objectives will probably mean 
less "coverage" of content. However, given the 
changing nature and role of content in modern so- 
ciety, 9 less coverage of content in most schools 
can probably be considered a side benefit of di- 
rect instruction in thinking. Most classes are so 
overloaded with factual information there is little 
time for anything else. Less content coverage 
would increase time to teach critical-thinking 
skills, among other, more useful and meaningful 
skills. 



Recent research indicates that rarely, if at all, do 
schools provide students with direct instruction in 
the cognitive or metacognitive strategies necessary 
to perform academic tasks. Yet such instruction 
can drastically improve student performance. 
Instead, content instruction is permeated by an 
emphasis on factual information. 



A Narrow View of Assessment 

Closely related to the barrier of a narrow view 
of curriculum is the view of assessment. In his 
commissioned study of academic work in schools, 
Walter Doyle 10 found that accountability drives 
student/teacher interactions. Once students have 
reached the middle grades, they tend to take 
seriously only those tasks for which they are 
held accountable. 11 If the teacher (and thus the 
textbook and the standardized test) holds stu- 
dents accountable only for factual-content knowl- 
edge, students will focus their attention on learn- 
ing that information even if metacognitive and 
cognitive strategies are taught directly and are 
a formal part of the curriculum. In other words, 
teachers must not only teach metacognitive and 
cognitive strategies they must also assess stu- 
dent competence in these strategies to communi- 
cate the message that they are, indeed, valued 
learning goals. One cannot expect students to 
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perceive their intrinsic value. Assessment, then, 
is inexorably linked with instruction because 
students tend to learn best that on which they 
are assessed. 

Unfortunately, most metacognitive and cogni- 
tive strategies do not lend themselves to objec- 
tive paper/pencil types of assessment. They are 
most easily assessed through qualitative types 
of measurement, including unobtrusive and ob- 
trusive observations of students engaged in spe- 
cific academic tasks. Such techniques are not 
without precedent in the classroom. In assessing 
reading competence, Yetta Goodmau" recom- 
mended the use of "kid watching." Students are 
observed as they use reading materials in some 
natural setting, ^he teacher interacts with stu- 
dents to find h r they use specific cognitive and 
metacognitr strategies. He or she also keeps 
anecdotal • ;ords of these interactions, using 
them to y d student strengths and weaknesses. 
Assessir ^c, Goodman said, is not something 
that oc aXS only at testing time. Rather, it is an 
ongoing part of the teaching/learning process. 



The shift from a narrow view of assessment to a 
broader perspective is fundamentally a policy 
issue. Those in positions of authority at the local, 
state and national levels must issue a clear man- 
date that assessment techniques should not be 
comprised primarily of objective, quantitative 
measures. Instead, more holistic and qualitative 
measures must be legitimized within education. 



In a similar vein, J. C. Campione and A. L. 
Brown 13 have developed an assessment tech- 
nique which they refer to as "dynamic assess- 
ment." Their technique involves presenting stu- 
dents with gradually more explicit cues for per- 
forming a task. The initial hints are very gen- 
eral, the succeeding ones become progressively 
more specific and more concrete with the last 
"hint" actually providing a detailed blueprint for 
generating a correct answer. In this system the 
metric of learning efficiency is the number of 
hints required for the attainment of a correct 
answer. 

The use of more qualitative assessment tech- 
niques such as these requires a dramatic shift 
away from viewing assessment as a matter of 
administering standardized tests to a broader 
view of assessment as an array of both qualita- 
tive and quantitative techniques. According to 
Walt Haney, 14 such a shift would not at all vio- 
late the original intention of standardized tests. 



Tracing the history and development of testing 
in this country, Haney painted a picture of grad- 
ual reliance on standardized tests as the major 
criterion measure of performance. As original- 
ly intended, however, standardized tests were 
meant to be used as one of many pieces of data 
with which to assess student performance. This 
point is well articulated in the Standaids for Edu- 
cational and Psychological Tests, as developed 
by the American Psychological Association, the 
American Educational Research Association and 
the National Council on Measurement in Edu- 
cation: 15 

A test score should be interpreted as an esti- 
mate of performance under a given set of condi- 
tions. It should not be interpreted as some abso- 
lute characteristic of the examinee ^ some- 
thing permanent and generalizable to all other 
circumstances. 

Again, the shift from a narrow view of assess- 
ment to a broader perspective is fundamentally 
a policy issue. Those in positions of authority at 
the local, state and national leve'u must issue a 
clear mandate that assessment techniques should 
not be comprised primarily of objective, quanti- 
tative measures. Instead, more holistic and quali- 
tative measures must be legitimized within edu- 
cation. Similarly, grading criteria should not" 
focus solely on knowledge of factual information 
but must include performance on specific meta- 
cognitive and cognitive strategies. 

Involvement of Noneducator Groups 
in Pedagogical Decisions 

The last barrier to the implementation of think- 
ing-skills instruction is rapidly becoming the 
most severe. Within many thinking-skills pro- 
grams are found each metacognitive and cogni- 
tive strategies as uje of affirmations and visual- 
ization. Even thi vgh these techniques have a 
strong cognitive research base, 16 they have come 
under attack from such noneducator groups as 
the Eagle Forum because of their alleged origin 
in religions beliefs. Many schools and districts 
which have field tested and accepted these tech- 
niques are adhering to demands to ban the tech- 
niques in spite of their proven worth. 

Similarly, some noneducator groups have at- 
tacked many of the techniques associated with 
critical thinking. For example, theorists such as 
Richard Paul" consider a dialectic view of the 
world as essential to critical thinking. He states 
that students can be *aught comprehensive prin- 
ciples of rational thc-ught. They can learn to con- 
sider it natural that people differ in their beliefs 
and points of view, and they can learn to grasp 
this not as a quaint peculiarity of people but as 
a tool for learning. They can learn how to learn 
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from others, even from their objections, contrary 
perceptions and differing ways of thinking. 18 

To foster dialectic thinking, Paul encourages 
such classroom practices as: 

• Having students attend community meet- 
ings or watch television programs on which 
different viewpoints are expressed; 

• Inviting persons with controversial views to 
speak in classrooms; and 

• Having students read literature that reflects 
values and traditions different from theirs. 

Again, these practices, although supported by 
a rich body of research, are being abandoned by 
districts because of the objections of various pres- 
sure groups. 

Stemming this mounting tide of noneducator 
involvement in pedagcjncal decisions is clearly 
another policy issue. Distinctions as to the re- 
sponsibility of educators versus noneducators 
must be established and articulated at all policy 
levels. No doubt this will be a difficult and emo- 
tional process in some schools and districts. How- 
ever, if education is to fulfill its promise, it must 
be allowed to utilize the resources provided it by 
the rapidly growing body of research and theory 
on human cognition without interference from 
special-interest groups. 



Conclusion 

The teaching of thinking holds great promise 
for American education. It is a promise seen by 
John Dewey when he wrote: "The sole direct 
path to enduring improvement in the methods 
of instruction and learning consists in centering 
upon the conditions which exact, promote and 
test thinking." 19 Similarly, in 1961, the National 
Education Association (NEA) envisioned the pro- 
mise when it stated: 

"Thus in the general area of the development 
of the ability to think, there is a field for new 
research of the greatest importance. It is essen- 
tial that those who have responsibility for man- 
agement and policy determination in education 
commit themselves to expansion of such research 
and to the application of the fruits of this re- 
search. This is the context in which the signif- 
icant answers to such issues as educational tech- 
nology, length of the school year and content of 
teacher education must be sought and given." 20 

As the NEA citation indicates, the promise of 
teaching thinking can be realized only if some 
significant changes are made and defended at 
the policy level. Immediate actions should be 
taken in the areas outlined above if thinking- 
skills instruction is to survive within American 
education.D 
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Literacy and Accountability 



by Rexford Brown 



The current testing and accountability 
systems in education are out-of-date for 
today's students and can conflict with 
efforts toward a richer educational 
experience for all students. 



Many state leaders are calling for a "second 
wave" of reforms aimed not at improving stu- 
dent performance on the basics, but at creating 
much higher levels of literacy for a much broader 
range of students. State and local boards of edu- 
cation are increasingly requiring instruction in 
such things as "thinking," "critical thinking," 
"problem solving," "ethics," "inquiry" and "learn- 
ing to learn." Recently, the Carnegie Forum on 
Education and the Economy declared that basic 
skills and literacies appropriate for the routi- 
nized work of early 20th Century mass produc- 
tion are inappropriate for the information-based, 
high technology, cutting-edge economy now tak- 
ing shape in the United States. 

The forum's report, A Nation Prepared: Teachers 
for the 21st Century, calls for "ability to reason 
and perform complex nonroutine intellectual 
tasks . . ."; "people with an ability to see patterns 
of meaning when others see only confusion . . ,"; 
people with a "cultivated creativity . . ."; people 
who know how to learn all the time and are im- 
bued moreover "with a set of values that enable 
them to use their skills in the service of the high- 
est goals of larger society." 1 

Such ambitions are not new; statements as lofty 
have been written in every era of American edu- 
cation. What is new, however, is the assertion 
that our schools "must graduate the vast major- 
ity of their students with achievement levels 
long thought possible for only the privileged few." 
That is a tall order for a system based on the 
assumption that only a few students are capable 
of developing the most sophisticated levels of 
literacy and only a few need to be so cultivated. 2 



Dr. Brown is Director of the Policy and the Higher Literacies 
Project of the Education Commission of the States. 



Unfortunately, fewer and fewer students have 
been exhibiting these higher levels of literacy 
over the last decade, according to numerous indi- 
cators such as the National Assessment of Edu- 
cational Progress. 3 Moreover, few classrooms or 
schools lend themselves to training in higher- 
order literacies. 4 Teachers talk while students 
listen passively; vigorous discussion and debate 
are rare. Teachers who want to develop the ap- 
propriate skills, habits and dispositions in their 
students are far too often constrained by the very 
conditions of teaching. Class time is too short 
for extended discussion. There are too many stu- 
dents to permit either discussion or much writ- 
ing. Students are used to being passive and like 
it that way. Many schools prize quietness over 
the hubbub of young people solving problems. 
Control is often more important than education; 
giving students questions to which there are no 
easy answers is threatening to teachers who are 
being evaluated for their success in producing 
students who can regurgitate facts. 

The higher literacies challenge requires policy- 
makers to examine any policies that might sup- 
port these constraints. Many such policies stem 
from desires for certain kinds of accountability: 
minimum competency tests for teachers and stu- 
dents; quantitative indices of time on task, cur- 
riculum coverage, and student progress; and ela- 
borate paperwork requirements to satisfy the 
diverse information needs of elaborate bureauc- 
racies. Many of these accountability policies are 
"minimums-oriented"— that is, developed to in- 
sure the public trust and monitor the investment 
of billions of public dollars. 

The question we face today, however, is whether 
one can stimulate maximum school performance 
with minimum standards (and, some would add, 
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minimum teacher salaries, minimum learning 
materials, minimum parental involvement and 
minimum imagination). Here state education 
policymakers find themselves with little recent 
experience. 

In particular, the higher literacies challenge 
poses some interesting dilemmas for state and 
district testing programs. To begin with, if higher 
literacies instruction requires students to de- 
velop new habits and dispositions through more 
critical thinking, more problem solving, more 
reading and extended writing, then schools will 
need new kinds of tests. They cannot assess these 
more complex activities with the current stan- 
dardized, multiple-choice, norm-referenced com- 
mercial tests so widely used to gauge school prog- 
ress. More appropriate are open-ended kinds of 
questions and tasks, interviews, observations 
and a wide variety of school-based and nonschool- 
based approaches to evaluation. 

These, however, appear to present many prob- 
lems. They may be more time-consuming and 
more difficult to carry out fairly and efficiently. 
Do we know enough about something such as 
problem solving to develop dependable instru- 
ments? Can higher literacies tests be objectively 
scored? What about their reliability and valid- 
ity? Higher literacies evaluations that require 
essays or performance or portfolios or group work 
or contextual observation do not lend themselves 
to the quantification necessary to report prog- 
ress to parents, school boards and newspapers. 
They appear far more costly than machine-scored 
tests, and of great concern to policymakers, they 
seem to defy standardization. We rely upon stan- 
dardization to ensure fairness, keep testing costs 
low and permit statistical comparisons useful for 
planning and policy making. 

A second set of problems occur with respect to 
the influence of testing on teaching. To the ex- 
tent that the scores on commercial, standardized 
tests are used to put pressure on schools, both 
teaching and curriculum tend to emphasize what 
can be tested in these simple formats. A learn- 
ing environment designed to produce success on 
multiple-choice tests is not a learning environ- 
ment conducive to instruction in higher liter- 
acies. 

Presumably, higher literacies evaluations such as 
those discussed above would force many teachers to 
educate students rather than prepare them for 
multiple-choice tests. (The difference is clear 
wherever essay examinations have replaced mul- 
tiple-choice tests of grammar and usage; the latter 
can be dealt with through drill and memoriza- 
tion, but essay exams require teaching students 
how to write.) However, if teachers and schools 
began to create the appropriate learning environ- 
ments, we might again lose that capacity to 
standardize that seems crucial to accountability. 



Higher literacies environments and tests are 
often "open-ended"; neither teacher nor student 
necessarily knows where an inquiry will lead, 
what will happen along the way, how long it will 
take, what course of action is preferable or what 
a "correct answer" might be. What happens to 
curricular mandates under such circumstances? 
What happens to textbooks and their accompany- 
ing tests? How can a principal or parent eval- 
uate two science teachers who have gone off on 
entirely different paths? 



The more kinds of performance data we want 
and the more comparisons we want to make ob- 
jectively and efficiently, the more we require stan- 
dardized tests. On the other hand, the more we 
move toward the climates and behaviors con- 
ducive to acquisition of higher literacies, the 
lower our capacity to standardize, measure and 
easily describe educational progress. 



If accountability measures moved in the direc- 
tions suggested by higher literacies goals and 
if teachers thereupon followed the lead to create 
more appropriate learning environments, what 
would happen to school organization, manage- 
ment and leadership? Structural changes would 
most likely be idiosyncratic, threatening the 
standardization of background factors that help 
planners and policymakers interpret test results. 

Our dilemma should now be clear: The more 
kinds of performance data we want and the more 
comparisons we want to make objectively and 
efficiently, the more we require standardized 
tests. On the other hand, the more we move toward 
the climates and behaviors conducive to acquisi- 
tion of higher literacies, the lower our capacity 
to standardize, measure and easily describe edu- 
cational progress. 

There is, then, a tension between three differ 
ent policy imperatives: to promote better educa- 
tion for all students, to measure progress toward 
that goal and to hold public servants account- 
able for their roles in that progress. If the con- 
ditions necessary for carrying out the second and 
third imperatives undercut the first, the g;ame 
is over. 



Getting Out of the Bind 

Testing and assessment people should be ask- 
ing a number of questions about their programs 
these days. They should determine first of all the 
extent of accountability demands stemming from 
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state and local laws, mandates, rules and regula- 
tions. There could be considerably more going 
on than any one person in the system knows 
about, especially if one includes commercial stan- 
dardized tests, minimum competency tests, state 
assessments, teacher and principal certification 
exams, teacher competency tests, SATs and ACTs 
(wrongly) used as outcomes measures and all 
paperwork associated with there and with other 
compliance measures. Three questions are crit- 
ical: 

• How much is all this costing the taxpayer 
and are the costs worth the benefits (i.e., the 
publicity and the capacity to say people are 
being held accountable)? 

• How much teacher preparation time and direct 
teaching time is consumed by accountability 
demands and their associated paperwork? 

• How much student learning time is intruded 
upon by accountability tests and assessment 
not directly related to what students are study- 
ing? 



Teachers who want to develop the appropriate 
skills, habits and dispositions in their students are 
far too often constrained by the very conditions 
of teaching. Class time is too short for extended 
discussion. There are too many students to permit 
either discussion or much writing. 



• Research being conducted at the Education 
Commission of the States suggests that most 
state and district testing people and policy- 
makers do not have sufficient data to answer 
those questions. In fact, although tens of mil- 
lions of dollars are spent every year on test- 
ing, assessment and accountability measures, 
there is little hard evidence that any of it has 
had either positive or negative impacts upon 
educational quality. Testing critics charge 
that great damage has been done, but they 
do not separate out of the various potential 
causes of that damage and have few empir- 
ical studies to cite. 5 Test and assessment di- 
rectors, on the other hand, bemoan the fact 
that they can find little evidence that their 
tests influence anyone at all. "Most of our 
information never gets used," the director of 
a msuor state assessment told me recently. 
"When we asked districts what kind of help 
we could give them, a msuority said they want 
to learn how to use test data. They don't know 
how right now." 
Research bears out this observation. Leslie 
Salmon-Cox and other researchers discovered in 
several studies that each actor in the system 



thinks someone else is using the test data, even 
though he or she is not. 6 Teachers do not need 
commercially prepared tests to tell them which 
of their students are faring poorly, but they 
think principals need the results. Principals say 
they don't use the data, but teachers and cen- 
tral administrators need them. Central admin- 
istrators say they don't do much with the tests 
results, but they believe principals and teachers 
use them heavily! The only people everyone agrees 
are using test data are newspaper editorial writers, 
school board candidates and people so distant 
from the schools they have no idea what the re- 
sults might mean. 

The first step out of the testing/higher liter- 
acy dilemma, then, is to find out what kinds of 
accountability demands are in place, how much 
time and money they consume and how or whether 
the data are being used intelligently. The sec- 
ond step is to find out whether accountability 
demands actually have an impact on teaching, 
learning and curriculum. Specifically, we should 
ask: 

• Do teachers "teacn to the test" at the ex- 
pense of other teaching possibilities? 

• If the answer is yes, what kind of teachers 
teach to the test, under what conditions and 
with what results for their students? Would 
these teachers be capable of higher literacy 
instruction if they, were not teaching to the 
test? 

• Do standardized tests influence teachers' ideas 
about good testing? Tuzt is, do teachers tend 
to model their own tests on the formats and 
assumptions of standardized tests? 

• Do high-stake tests, such as state-mandated 
competency exams, force teachers to narrow 
the curriculum to what can be tested with 
standardized multiple-choice tests? 

• Do high-stake tests influence students to dis- 
regard material that is not going to be tested? 

• Do accountability demands discourage risk- 
taking or experimentation in either teaching 
cr curriculum? 

There is overwhelming anecdotal evidence (sup- 
ported by common sense) that many teachers 
"teach to the test" when the stakes for them or 
for their school are high enough. And if the test 
is reductive, focused primarily upon recall of 
facts and limited only to what can be most easily 
measured, then it follows that instruction— at 
least while teaching to the test is taking place- 
will be reductive, narrowly focused and fact based. 

As the saying goes among teachers, "What's in- 
spected becomes what is expected." Many teachers 
and students alike reason that if they are not 
going to be evaluated on something, there is no 
point in teaching or learning it. We might guess 
that the poorer teachers act this way and that 
excellent teachers do not. But again there is very 
little hard data to go on. 
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So strong is the presumption that teachers will 
teach to the test that in some districts and states 
that axiom has become the primarily rationale 
for creating more innovative and challenging 
tests. The Pittsburgh Public Schools, for example, 
have been developing a higher-order of think- 
ing skills assessment knowing full well that when 
teachers try to teach to it, they will be forced to 
alter their instruction for the better. The same 
thinking undergirds assessment activities in Con- 
necticut, California and Michigan. Objectives for 
the upcoming Michigan-reading assessment (dis- 
cussed elsewhere in this issue) are being circu- 
lated far in advance of the actual assessment in 
hopes of stimulating new thinking about the 
nature of reading instruction and nudging people 
to begin to change their programs so they will 
not be embarrassed when the assessment comes 
around. This strategy, however, does not have 
uniform results- In a survey of Michigan school 
districts last year, opinion was about evenly di- 
vided with respect to whether the assessment 
represented an impetus for change and a guid- 
ance for change or whether they resulted in a 
narrowing of the curriculum and political ex- 
ploitation. 

Several school districts in California have de- 
vised tests in various subject areas that encour- 
age more curricular innovation and teacher cre- 
ativity. The Mountain View-Los Altos School 
District near San Francisco has developed a writ- 
ing sample and tests in biology and U.S. history 
that encourage teachers to be more creative. The 
San Juan and Conejos Valley School Districts 
both employ the Golden State Assessment, which 
includes many items designed to assess higher- 
thinking skills and problem solving. However, 
just as we have little hard data about the nega- 
tive effects of simplistic tests upon teaching and 
curriculum, we have little hard data about the 
positive effects of more challenging tests. 

Having satisfactorily answered questions about 
the impact of current accountability measures, 
policymakers will be able to move in new direc- 
tions. Two further endeavors necessary to lessen 
the conflict between current accountability sys- 
tems and the need for higher literacies are more 
flexible notions about the nature of accountabil- 
ity and incentives to develop new tests and test 
procedures more conducive to higher literacies 
education. 

It may help to demystify school accountability 
systems by acknowledging that they are just 
management systems. Corporations revise man- 
agement systems all the time as they grow and 
change; at particular points in a company's life 
a merit system that forces staff competition may 
be the best approach; at another time a team 
building system might be best. Hierarchical sys- 
tems dependent upon exhaustive financial anal- 
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yses were popular in the 1950s and 1960s; the 
1980s appear to favor horizontal management, 
empowerment and corporate culture. If the rest 
of the world can adopt new management sys- 
tems, there is no reason in principle that schools 
cannot. 

Key to a good management system is that it 
is fair; that it rests upon the most important and 
relevant information; that it is supportive of 
overall goals; that it does not consume more re- 
sources than it is worth; that everyone learns 
from it; and that the people closest to various 
problems get the information they need to solve 
those problems. 

School accountability systems can get bogged 
down when people connect fairness to objectivity 
in too rigid a way. One can be perfectly fair with- 
out being "objective" in the scientific sense. If 
we did not believe that, we would have a very 
different legal system. The quest for precision 
and objectivity in matters when human judg- 
ment is more appropriate and accurate can turn 
the noblest of intentions into the most nonsen- 
sical programs, especially in bureaucratic en- 
vironments. And policymakers should never do 
anything that encourages bureaucrats to be more 
bureaucratic than they already are! Account- 
ability means nothing if the measures used to 
establish it have nothing to do with the enter- 
prise being managed. Good managers want rele- 
vant information. As more and more policymakers 
want to know more about the true quality of edu- 
cation, current indicators will become increas- 
ingly useless. The best hedge against this mis- 
match is a broad set of robust indicators and re- 
lentless effort to prune out data that do not get 
used. State policymakers could create incentives 
and rewards for managers who succeed in tar- 
geting and streamlining these systems. 

Most importantly, an efficient management 
system provides each actor with the information 
(and only that information) he or she needs to 
do the job well. Teachers need certain kinds of 
diagnostic information about individual students. 
Principals need information about individual 
teachers, groups of teachers and groups of stu- 
dents. Central office administrators need unique 
kinds of information about schools, and state 
policymakers yet another set of needs. No one 
test or assessment can meet all of these needs. 
A true accountability system holds each actor 
responsible for what he or she contributes to the 
enterprise. To be sure, one needs student per- 
formance data of various kinds; but one also needs 
data about how well principals, superinte mts, 
counselors, school board members and otl js are 
doing their particular jobs outside the classroom. 

If we start from this principle, we get a much 
more flexible set of possibilities. There is really 
no need for the state to -collect data on every 
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student, for instance. State policymaking does 
not require that much detail (which is probably 
why so little of it gets used). States can sample 
schools and students sufficiently to monitor broad 
trends. Large districts, too, can sample or ex- 
trapolate trends from the all-pupil tests admin- 
istered in schools. 

Districts and school have several ways of deal- 
ing with their simultaneous needs for standard- 
ization and greater individualization of tests to 
keep pace with innovation. One approach is to 
specify certain core indicators and require that, 
say, only 50 percent of each school's information 
to be tied to the indicators. The other 50 percent 
could be relevant information as defined and 
measured by the schools and their communities 
in whatever way they think most appropriate. 
The state can help in this by providing work- 
shops and technical assistance for districts that 
want to move ahead in this area. 

Another approach is to take advantage of emerg- 
ing test construction theory that promises ways 
of ranking different performance tasks on the 
same scale. Because this kind of effort is pretty 
sophisticated, state help would again be neces- 
sary. The payoff, however, Avould be great: teachers 
and schools could feel free to experiment and 
pioneer new ways to assess complex skills and 
behaviors without fear of inappropriate test score 
pressures. 

There are, in fact, numerous ways to assess 
behaviors such as curiosity, love of reading, prob- 
lem solving, analysis and other higher literacy 
indicators. The be3t strategy for validating, rep- 
licating and spreading such measures is a two- 
fold, top-down and bottom-up one. The state should 
take the lead in setting goals for achievement 
that cannot be measured with current commercial 
standardized tests. It should then challenge both 
its own assessment people and schools and teachers 
to come up with efficient indicators. 

For their part, teachers should be relentless in 
their efforts to force accountability testing to move 
off the safe shores of basic skills and into deeper 
waters of comprehensive education. Teachers 
know talent when they see it, and they know 
successful learning when they see it. They are 



not, however, well-schooled in methods of trans- 
lating those recognitions into comprehensive 
evaluation programs. In the last analysis, this 
is what state policy will have to help them achieve. 
Once more teachers— like other professionals- 
become involved in setting and policing their 
own standards, their own assessment skills should 
improve. A teaching force in which there is strong 
public confidence and a teaching force no longer 
dependent upon outsiders for information about 
it accomplishments will go a long way toward 
resolving the dilemmas we face today.:: 
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New Directions in 

Statewide Reading Assessment 



by Karen Wixson, Charles W. Peters, 

Elaine M. Weber and Edward D. Roeber 

The Michigan state reading assessment lays 
out a salutary example of how states can 
use their testing programs to encourage 
innovation in teaching and curriculum. 



Editor's Note: 

In the effort to improve schools, Michigan has 
been tackling one of the most frequently cited 
problems of American education— lack of critical 
reading skills. A new definition of reading is af- 
fecting every area of educational practice, in- 
cluding policymaking, assessment, instruction 
and teacher training. 



In 1983, a joint committee of the Michigan 
Department of Education (MDE) and the Mich- 
igan Reading Association (MRA) developed a 
"new" definition of reading. It had become clear 
in a review of reading objectives that the exist- 
ing definition did not reflect current research 
and theory. It implied that reading is a static 
process, comprised of a series of sequential and 
hierarchical skills. 

Current theory views reading as a dynamic 
process in which the reader is an active partic- 
ipant. Readers derive meaning from the printed 
word based on what they bring to the reading 
situation in terms of experience, knowledge, skills 
and ability; how the information is presented in 
the text; and what effect context has. The new 
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definition views or describes reading as an "in- 
teractive" process, not one in which the reader 
is passive. 1 

"As a result, difficulty is no longer viewed as 
an absolute property of a particular reading skill 
or task, but rather as a relative property of the 
interaction among specific reading, text and in- 
structional factors . . ." says the position paper 
developed by MRA. 2 "This new definition 
recognizes that reading skill will vary from situ- 
ation to situation, and that skilled reading is the 
ability to tailor one's activities to the demands 
of each reading situation. Thus, within this con- 
text, skills are viewed as a means to an end, 
rather than an end unto themselves." 
'The MDE/MRA committee translated the new 
definition into a set of instructional objectives. 
After a period of review, including conference 
presentations, regional meetings and question- 
naires designed to obtain feedback from as many 
people as possible, the State Board of Education 
approved new "Essential Goals and Objectives 
for Reading Education" in the spring of 1986. 

A Good Reader 

The new reading objectives describe the char- 
acteristics of a good reader as outlined by recent 
reading research. This is in sharp contrast to the 
list of component skills provided by the previous 
objectives. The new ones are organized into three 
major categories: constructing meaning, knowl- 
edge about reading and attitudes, and self-per- 
ceptions. 
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First, good readers must be able to integrate 
their knowledge and skills as they decipher mean- 
ing for different texts under a variety of read- 
ing conditions. Second, good readers must have 
knowledge about the various purposes for read- 
ing, about how different reader, text and contex- 
tual factors can influence their reading, and about 
the skills and strategies they can use in their 
reading. Third, good readers are those who have 
developed positive attitudes about reading and 
positive perceptions about themselves as readers. 
Changes in the reading definition and objectives 
obviously must be accompanied by changes in 
assessment, instruction and professional develop- 
ment of teachers. 



Current theory views reading as a dynamic pro- 
cess in which the reader is an active participant 
Readers derive meaning from the printed word 
based on what they bring to the reading situation 
in terms of experience, knowledge, skills and 
ability; how the information is presented in the 
text; and what effect context has. 



Following development of the objectives, the 
MDE recognized that it next needed a plan for 
how the new objectives could be measured by 
the Michigan Educational Assessment Program 
(MEAP). It contracted with MRA to draw up a 
test blueprint. The blueprint specifies that the 
new objectives require tests that evaluate read- 
ing on a more holistic manner than the current 
MEAP tests. This means there will no longer be 
a one-to-one correspondence between each objec- 
tive and individual test items. Rather, groups 
of test items will correspond to the categories of 
the new objectives. In addition, there will be 
"topic familiarity" items to assess students' back- 
ground knowledge of the topics and ideas that 
are central to their understanding of the reading 
passages used on the texts. 

The topic familiarity part will be administered 
first, followed by three reading selections con- 
taining between 25 and 30 items each. Those 
passages will be representative of the materials 
students are likely to encounter in* their class- 
rooms—full-length stories and subject-area texts 
taken from materials such as children's maga- 
zines, literature anthologies and textbooks. The 
readability of the reading selections is deter- 
mined on the basis of factors such as how well 
the text is structured, its literary merit, the use 
of adjunct aids such as headings, charts and il- 
lustrations and the consistency of the text with 
the domain of knowledge it represents. This is 



in sharp contrast to the short, choppy passages 
and readability formulae that are used tradi- 
tionally with reading tests. 

About half of the items following each passage 
will be designed to evaluate students' ability to 
understand both narrative and informational 
texts. About 30 percent will test their knowledge 
of how the reader, text and context influence 
their comprehension. The remaining 20 percent 
of the items are a standard set of attitude and 
self-perception questions asked in relation to 
each reading selection. Students will be queried 
about their interest in the passage, how difficult 
the passage and the questions are and how well 
they think they understood the passage and ques- 
tions. The topic familiarity items will evaluate 
students' understanding of the concepts that are 
important to the comprehension of the reading 
selections. 

Finally, the blueprint also calls for new methods 
to report the results of the new tests. Because 
results no longer can be reported separately for 
each objective, it is likely the results will be re- 
ported in ways that describe a reader's perfor- 
mance under specified reading conditions, such 
as level of topic familiarity or interest in the 
text. The new MEAP reading tests are scheduled 
for implementation in the schools in the fall of 
1989, pending the results of pilot testing and 
final approval of the state Board of Education. 

Decision Making 

In addition to new assessments, teachers must 
have a full understanding of how the reconcep- 
tualization of reading affects instructional de- 
cision making. Teachers must be able to iden- 
tify: (1) what— the nature of the materials the 
student is reading (poem, short story, etc.) and 
the information to be learned (concepts, facts, 
literary themes); (2) why— the purpose for which 
the student is reading (enjoyment, to write a 
report, etc.); and (3) how— the skills and strate- 
gies the reader must use to perform the assigned 
task (to skim, to categorize, etc.). For example, 
if teachers were planning a unit on the Amer- 
ican Revolution, they would have to identify the 
content to be learned, the variety of materials 
to be read, the purposes for reading and the stra- 
tegies or skills needed to complete the required 
tasks. 

It is difficult to be precise about the conditions 
that made the Michigan project possible. Events 
at the national level, however, when the Michigan 
project began in 1982-83, helped create a polit- 
ical climate that was amenable to such change. 
The message these reports delivered to the na- 
tion was that there was an urgent need to im- 
prove the quality of our educational system in 
general, and literary learning in particular. 



ERIC 



Page 74 The Journal of State Government n /-> 



Another less-well-known result of the national 
reports was an increased recognition of the con- 
tribution research can make to educational re- 
form. As educational decision makers struggled 
with how to implement the recommendations of 
the reports, research on critical elements of the 
educational process became more valuable. The 
increased acceptance of researchers as "trans- 
lators" made it easier for them to become in- 
volved in the conceptualization of the Michigan 
project. In addition, the report of the National 
Institute of Education's Commission on Read- 
ing, Becoming a Nation of Readers, provided 
national support for Michigan's reconceptualiza- 
tion of reading assessment and instruction. 3 

The national reports also resulted in the es- 
tablishment of many state task forces to tackle 
the problem of educational reform, and Mich- 
igan was no exception. The state board's "Blue- 
print for Action" document enabled the MDE to 
form a curriculum review committee of teachers, 
administrators and university reading educators 
that has been instrumental in the development 
of the reading project. 4 This committee developed 
a review process for districts to use with their 
reading curricula and a consistent format for 
presenting the new definition of reading and the 
accompanying research. These were shared with 
more than 3,500 Michigan educators in a series 
of regional sessions held during 1984 and 1985 
to disseminate information about the project and 
receive feedback from large numbers of people. 

Lots of Time 

In addition, the curriculum review committee 
prepared a document on research and the class- 
room teacher which has been distributed to more 
than 21,000 people since 1984. But perhaps the 
most important factor at the state level has been 
generous amount of time that the state Board 
of Education and MDE have allowed for the com- 
pletion of this project. The state recognized the 
importance of using research in the development 
and implementation of education policy and has 
willingly provided the time necessary to accom- 
plish this goal. Also, because the state has many 
years of experience in developing new tests and 
because there is a test already in place, there 
is not the same time pressure to complete the 
new tests that may exist in states that are de- 
veloping a mandated testing program for the 
first time. 

The suppoi I of the MRA has been a critical 
factor in the development of the project. An af- 
filiate of the International Reading Association, 
MRA acts as the official representative of read- 
ing professionals within the state. It has served 
as the vehicle through which all interested par- 
ties have come together to work on the project. 



The significance of the Michigan project is that 
it illustrates a number of very important points 
about how state government can influence edu- 
cational change in a very positive way. By adopt- 
ing a view of reading that shifts th~ focus of as- 
sessment from a minimalist perspective to one 
that requires a higher level of integration of in- 
formation, Michigan was able to raise important 
questions about the reading curriculum. Thus, 
the new definition provides a framework that 
necessitates an adherence to a higher level of 
literacy by focusing on the interactive nature of 
the reading process. 

Therefore, MDE recognized that in order to 
move curriculum development in a more posi- 
tive direction, it would need to develop an assess- 
ment test that was more consistent with current 
research and practice. To do this required those 
in leadership roles within the state government 
to perceive themselves as leaders and innovators 
who could work in a collaborative manner with 
other professional agencies within the state to 
bring about the needed changes. 



Portions reprinted with permission of The Reading Teacher. 
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Writing in Nebraska 



by Joseph E. Lutjeharms and The Writing Task Force 



Nebraska provides an example of a state 
board of education trying to get out front 
on an innovative writing program that will 
require new assessment measures. Tlr* 
board hopes that innovative policy recom- 
mendations to teachers, policymakers, 
administrators and other leaders will 
improve students' writing skills. 



In the mid-1970s, two events occurred which 
were to have far-ranging effects on writing instruc- 
tion. Newsweek, in an article on "Why Johnny 
Can't Write," proclaimed for all what a number 
of people have been muttering for some time: A 
writing crisis was at hand. In addition, the Uni- 
versity of California at Berkeley invited success- 
ful elementary and secondary writing teachers 
to participate in a summer workshop to share 
techniques with one another. That workshop 
grew into the Bay Area Writing Project and ulti- 
mately into the National Writing Project (NWP), 
an-effort that has transformed writing instruc- 
tions and learning in thousands of classrooms 
across the nation. 

This concern about the writing abilities of Amer- 
ica's students has resulted in a marked increase 
in the amount of money and time devoted to re- 
search in writing. More research on writing in- 
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struction was conducted in the past decade than 
in the preceding century. Much of it agreed on 
the approaches that make a difference in writing 
skills and identified shortcomings of many tradi- 
tional patterns of writing instruction. 

As a result of the research conducted and of 
the growth of the NWP and dissemination of its 
practices, we have today a better grasp of what 
works and what does not. The research, how- 
ever, has not been widely applied in classrooms. 
In some, students are writing more than ever 
before, they are enjoying doing so, and they are 
writing better. But this is not the case in all 
classrooms—not even in most. The 1984 National 
Assessment of Educational Progress measured 
writing abilities of America's 4th-, 8th- and 11th- 
graders. Although some gains were noted since 
the first assessment in 1974, the overall tone of 
the report was disappointing: 

Analytic writing was difficult for students 
in all grades. Even on the easiest task . . . 
only 25 percent of the llth-graders, 18 per- 
cent of the eighth-graders, and 2 percent of 
the fourth-graders wrote adequate or better 
analysis In persuasive writing, stu- 
dents had difficulty providing evidence for 
their points of view. Fewer than one-third 
. . . wrote responses judged adequate or better 
.... A major conclusion to draw from this 
assessment is that students at all grade 
levels are deficient in higher-order think- 
ing skills. 
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New Directions 

Recent research points to teaching methods to 
overcome such writing deficiencies in our stu- 
dents. While it is an over-simplification to apply 
the phrase "process approach" to all the changes 
occurring in writing instruction, it does describe 
a significant portion of current thought and prac- 
tice. The term grew from research that centered 
on what writers do rather than upon what writ- 
ing is. Researchers found that most writing re- 
sults from a series of stages variously described 
as pre-writing, drafting, revising and publishing. 
These stages may well be recursive; that is, one 
may revert to pre-writing activities while draft- 
ing and may also revise in the drafting stage. 

That recursiveness is common in much writ- 
ing activity is important to realize, for tradi- 
tionally writing is viewed— and student writers 
are taught— that writing is linear. That is, the 
writer begins with individual words, puts them 
together to form sentences, links sentences to 
form paragraphs, and so on. If words are spelled 
correctly, sentences are formed correctly, para- 
graphs are indented and organized around one 
idea and ordered so their relationships to one 
another and to the overall purpose is clear, then 
the writing is successful. The process approach 
does not eliminate this attention to correctness 
of its product, but places it near the end rather 
than the beginning of writing concerns. 

Research also indicates that writing develops 
more quickly— and skills are learned more per- 
manently—when children first write and then 
the teacher reacts by helping the author with 
the skills necessary to revise the writing. The 
classroom changes when this approach— Write- 
Teach— is used as opposed to the traditional 
Teach- Write method. The content of the course 
is not the set of rules and skills presented and 
demonstrated by the teacher, but rather what 
the students generate in their writing. The teacher 
does not lecture or demonstrate a series of skills 
for the "/hole class. Instead, the teacher circu- 
lates among writers, converses with individuals 
about their writing, asks questions, makes sug- 
gestions and answers questions. 

The classroom becomes a writing laboratory 
in which experimentation is encouraged and re- 
warded. Writing is shared among students, and 
between students and teachers who write, too. 
Most writing is published in this classroom, dis- 
played on bulletin boards, bound into "books," 
read aloud; it is, in short, used as writing is used 
elsewhere: to communicate. 

A premium is placed upon teacher time in such 
classrooms, because most instruction occurs in 
short individual conferences between teacher 
and writer or between the teacher and small 
groups of writers sharing the same problems. It 



is entirely possible for teachers to lecture to 30 
or more students; it is difficult, if not impossible, 
to conduct a writing laboratory for that number. 

Research also has found that the primary method 
of teaching writing— the concentration on formal 
grammar—does not improve writing, and in fact, 
may prevent improvement because it takes time 
away from effective teaching and writing prac- 
tice. Although this seems to contradict what many 
associate with learning to write and to question 
the contents of most composition textbooks, the 
finding is not new. For 80 years, studies have 
constantly demonstrated that the study of for- 
mal grammar does not improve writing. One re- 
searcher found that "in some studies a heavy 
emphasis on mechanics and usage (e.g., mark- 
ing every error) resulted in significant losses in 
overall quality. School boards, administrators 
and teachers who impose the systematic study 
of traditional school grammar on their students 
over lengthy periods of time iu the name of teach- 
ing writing do them a gross disservice which 
should not be tolerated by anyone concerned with 
the effective teaching of good writing." 



Research also indicates that writing develops 
more quickly-and skills are learned more 
permanently— when children first write and then 
the teacher reacts by helping the author with 
the skills necessary to revise the writing. 



Nebraska's Efforts 

Against the background of a national "writing 
crisis," coupled with the additional research that 
surfaced over the past decade, the Nebraska State 
Board of Education authorized in April 1986 
the creation of a task force to study writing 
instruction and learning in the state and to 
make recommendations about what the state 
could do "to ensure that Nebraska's students 
receive effective instruction and adequate op- 
portunities to develop writing abilities." 

The task force reviewed the recent research 
in writing instruction and surveyed school ad- 
ministrators, English/language arts teachers 
and students about writing practice. It found 
that less than half the districts have a written 
plan for a district wide writing program. Less 
than 40 percent employ an evaluation plan to 
measure the outcomes of writing programs, 
and of those that do, more than one-third use 
norm-referenced instruments which test dis- 
crete proofreading skills without asking stu- 
dents to write. 
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Workbooks and grammar study dominate writ- 
ing instruction in Nebraska elementary schools. 
Fewer than 30 minutes per day are provided for 
students to practice writing in the majority of 
the schools. Most of that time is spent in prac- 
ticing such discrete syntactic units as sentences 
and paragraphs, with less than half of writing 
time devoted to writing complete units of dis- 
course such as letters, stories, and poems. About 
35 percent of elementary students believe that 
correct spelling is the most important part of 
writing, and more than 60 percent report that 
they talk to a teacher about rheir writing only 
"sometimes" or "seldom or never." Only 25 per- 
cent report using a computer "sometimes" to 
write. 



Research also has found that the primary method 
of teaching writing-the concentration or formal 
grammar— does not improve writing, and in fact, 
may prevent improvement because it takes time 
away from effective teaching and writing practice. 



The picture is not much different in the state's 
secondary schools. English teachers report that 
writing is taught in all their classes, but they 
require their students to write at least one para- 
graph two or fewer times per week. Grammar, 
usage and mechanics occupy a significant part 
of writing instruction in many schools: 45 per- 
cent of responding teachers said that at least 
half of the class time is spend studying these 
topics. Furthermore, teachers hold conferences 
with individual student writers fewer than four 
times per semester, and 65 percent of secondary 
school students say they never use a word pro- 
cessor to write. 



The Uses of Writing 

The structure of most writing courses we ex- 
amined contradicts much of what research shows 
to be effective. For example, schools often fail 
to recognize the primary purpose of writing—to 
communicate. This purpose is frequently absent 
because much of school writing is a form of test- 
ing. A certain amount of evaluation is necessary, 
of course, but if all school writing is a form of 
testing, then students can really not be held at 
fault if they come to dislike writing or if they 
copy, paraphrase or plagiarize instead of develop- 
ing their own distinct writing "voice." We know 
that when students are in control of their writ- 
ing for a particular audience, they write better 



than when they are addressing an examiner. As 
students progress through the grades, however, 
more and more of their writing is addressed to 
the teacher in the role of examiner, as much as 
80 percent or more in the upper grades. The re- 
sult is that writers have little experience in writ- 
ing to a variety of audiences. They write primar- 
ily in third person, thus having little opportu- 
nity to develop their own writing voice, and their 
attitudes about writing tend to be negative. 

Evaluation 

The standardized, or norm-referenced, test- 
so popular in the schools— also is an inappropri- 
ate measure of writing achievement or growth. 
While such tests may be predictiv.e of success 
in school or college and can be administered or 
scored efficiently, they do not yield useful in- 
formation about an individual's writing ability. 
Such tests do not measure performance on such 
important tasks as generating ideas, elaborat- 
ing and organizing, and finding a sense of audi- 
ence. 

Students must write, and that writing must 
be evaluated in consistent and valid ways. Two 
types of direct measures— holistic and primary 
trait analysis— may be employed. When teachers 
use holistic scoring, they read each paper for 
overall quality and assign it a score. Primary 
trait analysis yields more specific information 
about each student's abilities. Once the writ- 
ing assignment has been decided upon, teachers 
identify traits of a paper that respond success- 
fully to assignments. Because primary trait scor- 
ing yields more information about each student, 
it is more time-consuming to score and more ex- 
pensive to administer. Thus, it is more suited 
for small groups, while holistic scoring is more 
appropriate for large groups. Both are more use- 
ful to the school than standardized tests, how- 
ever. 



Textbooks 

Composition textbooks, by and large, have per- 
petuated traditional approaches to writing in- 
struction. Long on mechanics and grammar and 
short on opportunities for students to write, text- 
books have served the teacher who has little ex- 
perience or confidence in teaching writing. They 
have not served students. Although newer text- 
books devote more attention to process writing, 
schools evaluating textbooks for adoption should 
develop their selection criteria very carefully. Do 
texts consistently take control away from the 
writer by suggesting topics or employing story 
starters, or do they encourage writers to select 
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topics from their own experiences and to discuss 
writing ideas with peers? Do they suggest peer 
editing and provide help for editors? Do they 
emphasize the concept of drafting and revising? 
Do they, in short, attempt to assist the teacher 
in the direct teaching of problem-solving stra- 
tegies throughout the stages of the writing pro- 
cess, or do they substitute grammar and mechanics 
drills for writing? 

Word Processing 

The word processor can make writing less dif- 
ficult; revision is so simplified that it becomes 
almost pleasurable. The paper is neat and pro- 
fessional in appearance, but a number of teachers 
have reservations. They worry that using word 
processors will impair the development of pen- 
manship skills, that spell-checkers will reduce 
students' spelling performance, and that some 
students may come to rely so heavily upon a 
computer that they will be unable to write when 
one is unavailable. 

A more legitimate concern is the question of 
keyboarding skills. The pervasiveness of com- 
puters and their ever-expanding promise as an 
educational tool argue strongly for keyboarding 
to be taught in the elementary grades, & prac- 
tice many schools have already introduced. Spell- 
checkers do not automatically correct misspell- 
ings, and until such time as every student desk 
is equipped with a computer, students will con- 
tinue to employ pens and pencils and to practice 
penmanship. 

Early results of employing word processing in 
writing programs argue for expansion of the ef- 
fort. Students tend to become more fluent, to 
write longer papers, and to write more frequent- 
ly. Understandably, they revise more frequent- 
ly and more extensively. Perhaps most impor- 
tantly, students develop more positive attitudes 
about writing and about themselves as writers. 

Resources 

An obvious need arising from the task force's 
study is a mayor staff development effort that 
will help teachers and administrators implement 
in the classroom those strategies that do make 
a difference in writing instruction and growth 
of student abilities. The basic structures exist 
to support a statewide staff development effort. 
State colleges in Nebraska and elsewhere are 
located to serve many teachers, as are regional 
service agencies. 

Supporting and providing for a statewide staff 
development effort in writing is among the recom- 
mendations the task force made to tha state board 
of education. The state, it said, should involve 



universities and colleges, local districts, educa- 
tional service units, the Nebraska Writing Pro- 
ject and the Nebraska Department of Education. 

Other recommendations to the board to im- 
prove writing insvruction and learning in Ne- 
br^a include: 

• Make facility in the uses of English a pr. t- 
ity in state schools. 

• Require all teacher candidates to complete 
a three-credit-hour course or its equivalent 
on the teaching of writing as described in 
current research. 

• Require all teachers seeking recertification 
to complete a similar course. 

• Support pilot projects that develop and demon- 
strate effective and useful means of writing 
assessment and programs of writing across the 
curriculum. 

• Request local boards of education to explore 
changes in staffing patterns that will pro- 
vide students frequent opportunities to write 
and teachers the time to devote careful at- 
tention to each student's writing. 



The structure of most writing courses we examined 
contradicts much of what research shows to 
be effective. For example, schools often fa ; l 
to recognize the primary purpose of writing- 
to communicate. 



The task force recommended that boards of 
education and school administrators should: 

• Declare that all teachers must be competent 
in the uses of English and provide effective 
inservice programming to assist them. 

• Develop staffing patterns that will provide 
students with frequent opportunities to write 
and teachers with the time to give careful 
attention to each student's writing. 

• Support the professional development of ele- 
mentary and secondary teachers of writing 
through provision of inservice programming, 
at least partial financial support for teachers 
to attend state and national professional meet- 
ings and subscriptions to professional jour- 
nals. 

• Recognize the achievements of students and 
teachers through such means as honors as- 
semblies, student publications, school and/or 
departmental newsletters and contacts with 
the news media. 
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English/language arts teachers/ should: 

• Seek out and take advantage of opportuni- 
ties to learn about current theory and prac- 
tice in the teaching of writing. 

• Empower student writers by teaching the 
strategies of the writing process; encourag- 
ing them to select topics and to write fre- 
quently of their experiences and interests; 
encouraging the sharing of writing- and the 
talking about writing in the classro n; help- 
ing them find a variety of audieno.es; pub- 
lishing student writing; and incorporating 
word processing into the writing program. 

• Recognize the limitations of textbooks; re- 
ject those that fragment the writing process 
and/or emphasize grammar and drill over 
composing. 

• Provide opportunities for students to write 
rather than study grammar or drill on me- 
chanics. 

• Address problems in mechanics and usage 
in the proofreading stage of student writing 
during indi« dual conferences or in meetings 
of small groups of writers experiencing the 
same or similar problems. 

• Make writing classes places where writing is 
perform* id, discussed, revised and published 
rather than where it is only assigned and 
deposited for grading. 

• Assist teachers in other subject areas to in- 
corporate writing in their classes. 

• Communicate frequently with the adminis- 
tration, board of education and parents to 
establish the goals, methods, rationale and 
accomplishments of the writing program. 

• Provide rich and continuous reading experi- 
ence, including both published literature of 
acknowledged merit and the work of peers 
and instructors. 

The adoption of these recommendations will 
raise considerably the level of learning in Ne- 
braska and ensure that students are receiving 



the best possible instruction and the widest op- 
portunities to improve their writing skills in 
a manner far more meaningful and critical than 
current study of grammar and mechanics allows. 
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The Art of Questioning 



by Dennis Palmer Wolf 



How do teachers question students? Good 
questioning, the lowest cost of all higher- 
literacy teaching strategies, appears to 
be a rarely employed skill. 



Ask a teacher how he or she teaches and chances 
are the answer is, "By asking questions." How- 
ever, if you go on to ask just how questions are 
used, or what sets apart keen, invigorating ques- 
tioning from perfunctory versions, that same 
teacher might have a hard time replying. 

Consider several observations that have emerged 
from recent educational research: 

1. There are classrooms where teachers rarely 
pose questions above the read-it-and-repeat- 
it level. 1 

2. What questions and answers do occur tend 
to take place in a bland, if not boring or 
bleak, intellectual landscape, where stu- 
dents learn to expect little more than "uh- 
huh" for a reply. 2 

3 CI assroom questions are often disingenuous. 
Some are "rhetorical," never mind, sarcas- 
tic: "Are we ready to begin now?" 3 

4. Teacher questions can destroy, rather than 
build, a shared spirit of investigation. First, 
teachers tend to monopolize the right to 
question. As a result, rarely do more than 
procedural questions come from students. 
Second, the question-driven exchanges that 
occur in classrooms take place almost uni- 
formly between teachers and students, hardly 
ever shifting to occur between students. 4 

5. Questions can embarrass, rather than in- 
quire. They can leave a student feeling ex- 
posed and stupid, more willing to skip class 
than to risk being humiliated. 5 

From my point of view, it is not accidental that 
observations in arts and humanities classrooms 
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have provided an exceptionally rich context in 
which to examine questioning. In those classes, 
students can become deeply involved in creating 
or actively reinterpreting, rather than repeating 
knowledge. As a result, there occurs a level of 
investment that provides a foundation for pro- 
ductive questioning. In addition, if the arts and 
humanities are taught seriously and well, stu- 
dents confront information that has many layers 
of meaning and multiple interpretations. Those 
encounters provide an ideal— though certainly 
not the only— situation in which to look at the 
ways in which questions, along with other modes 
of inquiry, can be turned loose on materials that 
amply repay exploration. 

However, before turning to these classroom 
observations, I want to suggest that the issue 
of what questions are asked and how they are 
posed is, or ought to be, part of a much larger 
inquiry. Currently, there is a deep concern about 
how— or even if— we teach higher-level think- 
ing skills. There is startling evidence that many 
high-school students cannot draw inferences from 
texts, distinguish the relevant information in 
mathematics problems, or provide and defend a 
thesis in an essay. We have apparently developed 
a system of education where rote learning occurs 
early and inquiry late. We teach the skills to 
scribes and clerks, rather than authors and mathe- 
maticians. 6 We have come to accept a view of 
education that sees the experience of schooling 
largely in terms of its power to produce employ- 
able, rather than intelligent, students and that 
suffers from basic confusions over the conflicts 
between pluralism and excellence. 7 

However, embedded in this broad concern there 
is— or ought to be— a second critique, one that 
points out that the situation of disadvantaged, 
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minority, female and handicapped students is 
still more dire. 8 For many of them, skills such 
as analysis, hypothesis testing, discussion and 
essay writing may not just be taught late and 
meagerly— they may be virtually unavailable. 
These students live in an educational world where 
there is great confusion about different versus 
delayed paths of development and far. too little 
skill or support available for those whose growth 
is genuinely handicapped. 

Hence, when we examine skilled questioning 
(or instruction of any kind), it is essential to 
learn from those teachers who understand how 
to engage a wide community of learners. As one 
college teacher put it, "It's not hard to teach 
philosophy ty students who learned the rules 
of argument and evidence at the dinner table. 
That's a matter of dotting the i's and crossing 
the t's. The real issue is whether I can teach 
students who don't already come knowing." 



Students need the face-to-face skill of raising ques- 
tions with other people: clarity about what they 
don't understand and want to know; the willing- 
ness to ask; the bravery to ask again. 



The Art of Questioning 

Independent of whom they teach, skilled teachers 
question in distinctive ways: They raise a range 
of questions, they sustain and build arcs of ques- 
tions, their inquiries are authentic, they inquire 
with a sense of respect and decency. 

A Range of Questioning 

Thirty years ago, Beiyamin Bloom 9 suggested 
that the same information can be handled in 
more and less demanding ways— students can be 
asked to recall fact, to analyze those facts, to syn- 
thesize or create new information based on the 
facts, or to evaluate knowledge. Sitting in the 
back of arts and humanities classes reinforces, 
and perhaps expands, the sense that as a tool, 
the questions take many forms. 

An Arc of Questions 

But a variety of questions hardly creates a cli- 
mate for inquiry. At least as important is the 
way in which teachers respond to the answers 
their questions provoke. Thus, recent research 10 
suggests that too often students' replies meet 



with little more than a passing acknowledgment 
("Mmmm-mmmm" or "uh-huh"). Such responses 
stop inquiry in its tracks. In place of such dead- 
end situations, skilled teachers give an exchange 
of questions a life-course. Across a long arc of 
questions and answers, they produce a kind of 
microgenesis in which simple factual inquiries 
give way to increasingly interpretive questions 
until novel insights emerge. An observer has the 
impression of a kind of mutually constructed im- 
provisation unfolding. 11 It can be an improvisa- 
tion that stays alive for days, even weeks. 

The Authenticity of Questions 

Many of the questions that occur in classrooms 
are simply not genuine. Some— such as "Will you 
please put away your brushes and paints?"— are 
aimed at little more than conduct. Others— in 
fact, the majority— are insincere in another way. 
They are not requests for information the speaker 
genuinely needs— rather, they are checks to see 
if a student has the information a teacher already 
knows. 12 These covert commands and informa- 
tion checks are not evil— unless, of course, they 
are the only questions students hear. In that 
case, students lose the opportunity to see their 
teachers engaged in serious inquiry, where ques- 
tions function as bona fide tools for thinking and 
understanding. 

The way in which teachers question provides 
a kind of barometer for the social values of class- 
rooms—particularly questions of who can learn 
and who can teach. To begin, the way in which 
teachers question reveal whether they suspect 
learning flows only from a teacher or whether 
it can come from other students. 

Through their questions, teachers have the 
power to offer opportunities for dialogue to par- 
ticular groups of students or to withhold such 
opportunities from them. A 1982 study, for exam- 
ple, found that, when compared to their female 
peers, young males are much more likely to ask 
questions and to have them answered in a 
serious way. 13 Minority students' participation 
in classroom discussion is similarly endangered. 
We know that there are culturally organized dif- 
ferences between classroom and home regard- 
ing the appropriateness of asking questions, the 
rules about who can be questioned or what forms 
inquiries should take. 14 Yet, when minority 
students fail to join in classroom inquiry, teachers 
may interpret their hesitation, not as uncertain- 
ly about the rules of communication, but as lack 
of ability, ceasing to consider them valuable, 
contributing members of a class. 15 

Clearly, teachers can use questions to embar- 
rass or empower. For instance, questions can be 
designed to smoke out guilty parties— students 
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who didn't do their homework, who fail to answer 
quickly enough, or who can't think on their feet. 
But it is equally possible to use questions to pro- 
mote students' sense of themselves as knowledge 
able and skilled. 

Then Why So Few Questions? 

Teachers know questions to be one of their 
most familiar— maybe even one of their most 
powerful— tools. But if observations are accurate, 
much of classroom inquiry is low-level, short, 
even exclusive or harsh. Moreover, these quali- 
ties turn out to be remarkably resistant to change. 
Thus, the original study of questioning done in 
1912 16 found that two-thirds of classroom ques- 
tions required nothing more than direct recita- 
tion of textbook information. Now, more than 70 
years after the original study, 60 percent of the 
questions student hear require factual answers, 
20 percent concern procedures and only 20 per- 
cent require inference, transfer or reflection. 17 

Here, ironically, where the vital issue of what 
fuels or explains these persistent patterns of ques- 
tioning emerges, there is little or no research. 
But pieces of explanation exist both in the phe- 
nomenology of what teachers experience and in 
a wider analysis of classrooms as educational 
and social systems. 

When teachers hear the dreary statistics about 
classroom inquiry, they are quick to reply, They 
freely admit that they have colleagues who are 
simply not interested in the work of questioning, 
but they also point out that establishing a class- 
room where inquiry flourishes is not simple: 

There are 34 students in the room, some have 
read the story, others haven f t; some under- 
stand, others are lost. It takes skill— lots of 
skill— to put together a discussion for those 34 
people. Frankly, it is often easier for me to take 
charge. 

Questions work fine when you ha' ; students 
who have a set of prior skills— I mean who know 
about listening to what someone else says, who 
can follow up with a question of their own, who 
are used to digging for information. But what 
do you do when you don't find that? Do you stop 
to teach it? And how do you teach it, anyway? 

But teachers are adamant about not stopping 
the analysis at the level of individuals' skills or 
level of commitment: "Don't forget that teachers 
live day in and day out in a school culture. That 
culture teaches. In most places it teaches you to 
suspect that there is nothing to learn from stu- 
dents." In particular, teachers argue that school- 
ing takes place in the midst of a network of edu- 
cational and social assumptions that have pro- 
found effects on learning and teaching. 

To begin, teachers argue that learning in schools 
is shaped by a particular definition of learning, 



one that can be summed up in terms of subject- 
matter mastery, rather than the application or 
extension of knowledge or the invention of new 
knowledge: 

It is a cilture that puts coverage above all. You 
have to cover all of "Macbeth" in 12th-grade 
English, never mind how your students read. 
You have to get through World War II. What is 
begun by textbooks, tests enforce. In that world, 
questions, especially big messy ones, are danger- 
ous. You have to keep too many of them from 
happening. 



There is startling evidence that many high-school 
students cannot draw inferences from texts, dis- 
tinguish the relevant information in mathematics 
problems, or provide and defend a thesis in an 
essay. We have apparently developed a system 
of education where rote learning occurs early 
and inquiry late. 



What is to be learned is defined largely by what 
can be efficiently measured. Thus, whether th«y 
are weekly quizzes or examinations at major edu- 
cational transitions, identification and multiple- 
choice items appear early, and essays come late— 
if at all. Assessments based on whole or novel 
works are typically reserved for marginal popu- 
lations—students who reach the extra-credit sec- 
tion, advanced-placement students, art or music 
students. In such a climate, it is only adaptive 
to ask and answer a preponderance of factual or 
procedural questions— they are the curriculum. 

Teachers also sense a second, more elusive, 
educational assumption that affects how they 
teach. This is the assumption of a fixed scope and 
sequence— a ladder in which basic skills are seen 
as necessarily preceding "higher-level" inquiry 
skills. Typically, basic-level skills function as 
gatekeepers. A student who has difficulty spell- 
ing or writing whole sentences is not asked or 
allowed to write stories and essays or asked to 
interpret texts. In this way, inquiry skills are 
hoarded into the upper tracks or higher grades. 

Consequently, sophisticated questioning or in- 
vestigative strategies become the private pre- 
serve of the relatively few teachers and students 
in senior high school, advanced-placement classes 
or programs for the gifted and telented. So ac- 
cepted is the definition of basic and higher-order 
skills that we have lost sight of what may be a 
much more viable alternative— teaching inquiry 
to all students, in way3 that are tuned to their 
particular abilities. 
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Social Aspect of Schooling 

If subject-matter mastery and intellectual gate- 
keeping characterize the educational life in many 
schools, the social aspect of schooling has equally 
pronounced features. First, much of education 
takes the form of "batch-processing/' In high 
schools, through scheduling and tracking, much 
has been done to diminish the diversity of the 
30 individuals who fill the room. 

In addition, the very way in which r present 

information tends to homogenize lei- ring and 

points of view. For example, the majority of stu- 
dents learn their American literature by reading 
the same text at the same pace, guided by iden- 
tical questions. But if the point is to provide 
them with a deep sense of texture of American 
romantic writing, why not ask some to read Poe, 
some Longfellow, some Stephen Foster song lyrics, 
some contemporary British writers? That kind of 
dispersal and diversification of knowledge would 
make discussion essential. The cost of everyone 
reading the same works all the time is that we 
radically reduce students' (and teachers') reasons 
to inquire of one another. 

Finally, despite the group nature of virtually 
all public instruction, what goes on in classrooms 
is strangely asocial, constrained by a belief in 
individual achievement, rather than joint social 
construction of insight. If the prevalence of seat- 
work, individual homework assignments and 
strictures about discussing answers is any sign, 
there is a deeply held belief that turning over 
the process of instruction to group work is either 
abdication or cheating. Discussions, collabora- 
tive science projects, peer critiques are rare de- 
spite the fact that school hallways are full of 
adolescents whose major mode of learning is to 
copy, examine or argue with the knowledge of 
their peers. 

Not only does this asocial climate seem a waste 
of what adolescents do best (contend, doubt, tease), 
it also bottles up the natural cognitive energies 
of a situation in which differences of abilities, 
outlooks and points of view might motivate and 
inform inquiry. We have the wrong metaphor 
for learning. We need to replace the notion of 
the scholar isolated in a cave of books with a dif- 
ferent picture — something more like the neces- 
sarily collaborative atmosphere of a science lab- 
oratory or a theatre production. At a deeper level, 
we need to confront the mythology that joint 
work inevitably leads to homogenization, indif- 
ference or lack of achievement. 

So what do teachers see as answers? Concrete- 
ly, teachers want time to think about their 
classes as moments of joint inquiry— time to ob- 
serve skilled colleagues in action, time to see 
themselves on videotape, time to think through 



not just lesson plans but process plans: when to 
ask, who to ask and above all, how to respond. 13 
Teachers want not just to hear about how "pre- 
judicial teacher questioning patterns are," they 
want time to grapple with equity and excellence 
issues head-on, at the level of values and ethics. 

And most profoundly, teachers want to be en- 
gaged in inquiry themselves. Teachers want to 
join with scholars to think about curriculum as 
occurs in the Yale-New Haven Teachers Insti- 
tute or the university-school collaborations of 
the Los Angeles-based Humanitas Academy. They 
want to have their own skills probed and honed 
in the way that the Bay Area Writing Program or 
the Dialogue Program in St. Paul does by offer- 
ing them (not just their students) time to write. 
Simply pufc, many teachers want to learn about 
the skills demanded in questioning and other 
forms of inquiry— but they want to learn in ways 
that will sustain their own abilities to inquire 
and reflect. 

Why Question? 

If the challenges are this great, it is well to 
ask exactly what comes of being questioned? 
Some research concludes that students exposed 
to higher-order questions attain more than stu- 
dents without similar experiences, 19 but there 
is also evidence to the contrary. 20 If classroom 
inquiry is incidental— if lecture and recitation 
lead to the same levels of achievement— why 
bother? 

Possibly the reason to bother is that there is 
a competing view which suggests that student 
achievement— as it is traditionally measured— is 
not the only, or best, yardstick for measuring the 
effects of asking and answering good questions. 
Possibly we should be tracking two other, more 
difficult to measure, outcomes. 

First, there is a social outcome— students need 
the face-to-face skill of raising questions with 
other people: clarity about what they don't under- 
stand and want to know; the willingness to ask; 
the bravery to ask again. It is as central in chas- 
ing down the meaning of a dance, the lessons of 
the Korean War, or the uses and abuses of nu- 
clear reactors. One could rephrase the Chinese 
proverb: Give a man a question and he inquires 
for a day, teach a man to question and he in- 
quires for life. 

And there is a creative or inventive outcome. 
Being asked and learning to pose strong ques- 
tions might offer students a deeply held, inter- 
nal blueprint for inquiry— apart from the prods 
and supports of questions from without. That 
blueprint would have many of the qualities that 
teachers' best questions do: range, arc, authen- 
ticity. But if the sum is greater than the parts, 
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there might be an additional quality— call it a 
capacity for question-finding. 21 Question-finding 
is the ability to go to a poem, a painting, a piece 
of music— a document, a mathematical descrip- 
tion, a science experiment— and locate a novel 
direction for investigation. How, for instance, 
does a young musician go back to a Dvorak piece 
practiced and heard hundreds of times, and find 
a way of rehearing it, reinterpreting it, so that 
something novel is exposed? 

Here Gertrude Stein comes to mind. While she 
lay dying someone leaned over to ask her, "What 
is the answer?" and she, so long a practiced ques- 
tion-asker, still had to energy to quip, "What is 
the question?" 



This article originally appeared in its complete version 
in Academic Connections, Winter 1987, Copyright 1987 
by the College Entrance Board. All rights reserved. 
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Textbook Selection 
and Curriculum Change 



by Roger Farr 



Textbooks are an integral part of the 
education process. The selection of text- 
books can help or hinder efforts to 
broaden teaching or learning. How can 
textbook selection and usage be changed 
to help improve the education of students? 



Those who want to modify curriculum often 
look to textbooks as the means to bring about 
that change. However, changing textbooks is 
not an easy task. Everyone knows that textbook 
committees select textbooks, but how do they go 
about the task, and will textbook publishers pro- 
duce texts to meet the differing criteria of each 
committee? 

What are the facts about textbook selection 
and adoption: Do textbooks dominate classroom 
instruction? Will improved textbooks lead to bet- 
ter instruction? Can improved textbook selection 
procedures foster the development of better text- 
books? How effective are present textbook selec- 
tion procedures? How can textbook selection be 
improved? 

Textbook Selection and the 
Improvement of Education 

The selection of textbooks has become a matter 
of serious attention for most education policy- 
makers interested in curriculum improvement. 
Foremost among the reasons for this attention 
have been the claims of education critics who 
have argued that poor textbooks are one of the 
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primary culprits in the decline of the quality 
of education. In a speech before the American 
Association of School Administrators in Febru- 
ary, 1984, former Secretary of Education Terrel 
Bell criticized the content of textbooks used in 
schools, the textbook publishing industry and 
the policies and procedures of textbook adoption 
committees. Using the National Commission 
on Excellence in Education report, A Nation at 
Risk, 1 as the basis for his attacks, Bell said that 
schools are not spending enough for textbooks, 
that there has been a "dumbing down" of text- 
books due to a disproportionate concern with 
readability levels, and that present ineffective 
methods of textbook selection should be replaced 
with coordinated and cooperative efforts which 
provide educators with greater leverage for in- 
fluencing and shaping textbook content. 2 

Other critics have asserted that textbooks are 
incoherent, poorly organized, contain factual er- 
rors and are written to satisfy the requirements 
of a readability formula rather than being con- 
cerned with clear communication. 

In addition to the concern with the negative 
influence of poor textbooks on learning, policy- 
makers have read the research literature that 
suggests that most classrooms are textbook-dom- 
inated. These studies have shown that regard- 
less of the state- or school district-adopted cur- 
riculum, it is the textbook that determines what 
is taught in the classroom. Thus, they have de- 
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cided that if the curriculum is to improve, they 
must have more control over the textbooks that 
are used. 

Other critics of textbooks are disturbed that 
the content of certain textbooks refutes or con- 
tradicts their religious beliefs. The recent court 
cases in Hawkins County, Tennessee, and in 
Alabama emphasize the nature of these cases. 
While claims of this sort are not new, their con- 
tinuation and their success in getting some text- 
books removed from classrooms emphasizes their 
importance. 

Thus, textbooks are looked to as the culprit 
behind many of the ills of education, and the 
textbook adoption proct3S is seen as a means to 
bring about change. The solution rests on the 
assumption that textbooks are selected by a log- 
ical/thoughtful process that can be understood 
and modified— and therefore influenced. The kind 
of influences that seem to be suggested are to get 
committees to choose books that are more com- 
prehensive and difficult, that match local cur- 
riculum, and that are devoid of religious, ethnic, 
sexual (and all other) bias. By getting commit- 
tees to focus on these "important" factors in 
their selection process, the argument is made 
that better textbooks will be selected for use in 
classrooms. 

Furthermore, this focus is seen as the means 
to get publishers to produce better textbooks. 
The argument is made that if committees focus 
on these "important criteria," then publishers 
will produce the kinds of textbooks desired. 

There are, however, problems with this seem- 
ingly simple solution to improvement. In order 
to understand these problems, it is necessary to 
understand how the present textbook selection 
system functions. 

Do Textbooks Dominate 
Classroom Instruction? 

In most classrooms at both the elementary and 
high school levels in the United States, a text- 
book is the primary focus of instruction. Single 
textbooks, with accompanying workbooks and 
other supplemental materials, are used in 96 
percent of elementary reading classes. Paul Gold- 
stein concluded that textbooks are the focus of 
more than 75 percent of a pupil's classroom time. 3 

School district and state curriculum guides 
gather dust on teachers' shelves while textbook 
manuals determine courses of study. Teachers 
strive to "cover the text", and to complete all 
of the prescribed activities in the accompanying 
workbooks. As a result, they give little thought 
to the district's curriculum goals. If a textbook 
includes tests to accompany a .unit or chapter, 



worksheets for practice activities, homework as- 
signment sheets and study guide suggestions for 
reading each chapter, the chances of successful 
sales increase significantly. It seems some teachers 
want all of these things so their work is easier. 

However, it is not just the teachers who are 
to blame for this sorry state of affairs. The text- 
book adoption committees push publishers to 
match their texts to the district curriculum and 
publishers try to include everything listed in 
school curriculum guides. They strain to give 
schools a total curriculum wrapped up in a hard- 
bound cover— and it cannot be done. Attempts 
to do so lead to merely mentioning important 
topics, surface treatment of many subjects, in- 
appropriate labeling, and the inclusion of every 
teaching aid possible. 



The organization and coherence of textbooks 
should be a primary concern of textbook adop- 
tion committees. Studies have shown that better- 
written textbooks are easier to comprehend. 
Textbooks should pay attention to connections 
between ideas, overall structure of content, 
and introduction of new ideas and vocabulary 
so students can learn independently. 



More importantly, the problem is not just in- 
cluding all these extras and skimming the sur- 
face; the problem is that the major focus of a 
textbook as a tool of instruction gets lost when 
a textbook is developed to be a "do-it-all" cur- 
riculum. A textbook cannot be the total curric- 
ulum. However, as long as schools use them that 
way and textbook committees review them from 
that perspective, publishers will produce text- 
books that try to do everything and end up do- 
ing few things well. 

The organization and coherence of textbooks 
should be a primary concern of textbook adop- 
tion committees. Studies have shown that better- 
written textbooks are easier to comprehend. Text- 
books should pay attention to connections be- 
tween ideas, overall structure of content, and in- 
troduction of new ideas and vocabulary so stu- 
dents can learn independently. 

Will Improved Textbooks 
Lead to Better Instruction? 

There is, of course, no easy answer to this ques- 
tion. A number of studies have shown that dif- 
ferent textbook approaches have produced dif- 
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ferent learning. For example, studies in read- 
ing have demonstrated that children who use a 
textbook with a strong emphasis on phonics in 
first grade perform better on phonics tests than 
do those children whose textbooks emphasize a 
meaning approach. However, even with a topic 
such as phonics, which seems to be so clearly 
delineated in the textbooks, there is much dis- 
agreement about the influence of the approach 
used. 

Additionally, based on the evidence that text- 
books are a very important factor in determining 
the content and procedures used for teaching 
each subject, perhaps we should be concerned 1 
about decreasing the use of textbooks in class- 
rooms. As long as we continue to look for text- 
books as the salvation of education, it is unlike- 
ly that education will improve. As important as 
textbooks are, they pale in comparison to the in- 
fluence of a knowledgeable, motivated, interest- 
ing teacher. A good teacher uses a textbook to 
get where he or she wants to lead the children, 
not vice versa. We need to spend time teaching 
teachers how to teach so they don't slavishly 
follow a textbook. 



Publishers produce what they believe most 
schools will purchase, and they pay far greater at- 
tention to the large adoption states such as 
California and Texas (which purchase the same 
texts for all their school districts) than they do to 
the nonadoption states. Textbook publishers 
carefully review these states' curriculum guidelines 
as they plan the development of new textbooks, 
which are written to coincide with major states' 
adoption cycles. 



It must be the teacher who plans the instruction, 
selects the teaching materials, and paces and 
assesses each pupil's success. These crucial ac- 
tivities cannot be abandoned to the structure 
of a textbook. Every child and classroom is dif- 
ferent. "One size fits all" does not work with 
textbooks. Improving textbooks will not lead to 
significantly better instruction; only improving 
teachers will do that. John Maxwell, executive 
director of the National Council of Teachers of 
English, emphasized that point when he wrote 
that educators should stop hoping that textbooks 
can cover everything about a subject. Instead, 
educators must determine what is most impor- 
tant. 4 



Can Improved Textbook Adoption 
Procedures Foster the Development 
of Better Textbooks? 

The evidence that textbook publishers will 
produce what sells is overwhelming. However, 
it is not certain whether this fact can be used 
to influence the development of better books. 

The publishers agree that they produce "the 
very best textbooks that educators will purchase." 
Robert Follett wrote: 

From the publisher's standpoint, the text- 
book adoption process is the system that 
produces sales 

Successful publishers produce textbooks 
that appeal to adoption committees. These 
committees, composed primarily of profes- 
sional educators, make the selections that 
result in sales. A textbook is likely to ap- 
peal to a selection committee if it promises 
to make the job of the professional educator 
easier by facilitating classroom manage- 
ment according to established practices 
and procedures, and if it helps students to 
acquire necessary skills, knowledge or at- 
titudes. A book should also avoid contro- 
versy and not draw protests from the press 
or public. 5 

The influence of the large adoption states is 
a generally accepted fact. 6 - 7 There is little ques- 
tion that a few major states and their adoption 
committees presently determine the content of 
textbooks. Because of the influence of these large 
states, textbooks tend to become more alike than 
different. What is not so clear is whether the 
state adoption process will produce the best books, 
or whether we should be encouraging publishers 
to produce textbooks with different approaches. 
If it is diversity we want, then the large state 
adoption process is probably inappropriate. 

Publishers produce what they believe most 
schools will purchase, and they pay far greater 
attention to the large adoption states such as 
California and Texas (which purchase the same 
texts for all their school districts) than they do 
to the nonadoption states. Textbook publishers 
carefully review these states' curriculum guide- 
lines as they plan the development of new text- 
books, which are written to coincide with major 
states' adoption cycles. 

Several of the large adoption states have acted 
to improve textbook adoption processes and to 
use the process as a lever to improve textbooks 
as well as to gain greater control over the cur- 
riculum. Because of the large amount of money 
provided directly by the Texas legislature each 
time new books are adopted, Texas has always 
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exerted a strong influence on textbook content. 
In the past several years, California and Florida 
have attempted to improve textbooks through the 
adoption process. There is evidence that their 
influence is being felt by publishers, but it is not 
yet known whether better textbooks or improved 
learning will result. 

For example, in the recent California elemen- 
tary mathematics textbooks selection, the state 
selection committee rejected all of the submitted 
textbooks because they did not meet its curric- 
ulum guidelines. That single act will cause a 
serious reexamination of the mathematics text- 
books. California also has adopted a new frame- 
work for language arts instruction which will 
be used to select reading and language arts text- 
books next year. 

Florida has taken a somewhat different ap- 
proach. It has developed a fairly extensive train- 
ing program for all who take part in the review 
and selection of textbooks. In other states and 
local school districts increasing attention is be- 
ing paid to the text selection process. 

How Effective are Present 
Textbook Selection Procedures? 

Textbook adoption is a varied and complex pro- 
cess often discussed as if there were just two 
types— state adoption and loccl district adoption. 
Such discussions seriously over-simplify the situ- 
ation. Even cursory study reveals there is no 
monolithic textbook adoption process. Although 
22 states have some form of statewide adoption, 
their textbook adoption and purchase procedures 
and policies differ considerably. 

Some states adopt a list of not more than five 
texts, while others include "all those books which 
match the adoption criteria.' ' Several states 
adopt texts only at the elementary school level. 
In a few states, money is provided to purchase 
new texts; in other states, the money to purchase 
texts must come from each school district's gen- 
eral fund. 

The practices in the open-territory states (where 
school districts can select any textbooks rather 
than just those approved by the state) differ even 
more widely. In a few small districts, the super- 
intendent discusses textbook selection with a 
few hand-picked teachers before making a pur- 
chase recommendation to the board of education. 

In most large school districts, an elaborate set 
of review and advisory committees and proce- 
dures are established. Committees make text- 
book recommendations which are usually adopted 
by a board. Selection procedures may be formal 
or informal, and may have minimal or stringent 
criteria for textbook evaluation. 



A significant variation in the review and adop- 
tion process incorporates pilot studies subjecting 
textbooks to classroom use prior to their pur- 
chase. Sometimes the pilot studies are quite in- 
formal and take place over a couple of weeks. 
In other cases, the pilot studies last for an en- 
tire year and are accompanied by a variety of 
evaluation procedures. 



As long as we continue to look for textbooks as 
the salvation of education, it is unlikely that 
education will improve. As important as textbooks 
are, they pale in comparison to the influence of a 
knowledgeable, motivated, interesting teacher. 



Another mayor difference in textbook adoption 
procedures is the amount of contact committee 
members have with the representatives of text- 
book publishing companies. In some adoptions, 
contact between publishers and committee mem- 
bers is strictly forbidden. In others, textbook 
publishers present and describe their texts to the 
panel. Some committees allow the publishers' 
representatives to visit members as often as they 
like, and to use common sales promotion tech- 
niques to obtain sales. Committee members are 
taken to dinners, special textbook presentation 
sessions are held at vacation resorts, and special 
favors such as trips to professional conventions 
are provided. 

Criteria sheets listing factors that the commit- 
tee believes important in selecting textbooks 
provide further insight into the process and prac- 
tices of textbook adoption committees. A review 
of 70 sheets secured from school districts in both 
adoption and nonadoption states suggests some 
of the strongest influences on committee deci- 
sions. 

The only criterion listed on all 70 sheets was 
the copyright date, which apparently is used to 
determine how current the textbook's content is. 

Surprisingly, in light of criticism of the sup- 
posedly strong influence of readability formulas 
on textbook selection, only 73 percent of the sheets 
included readability as a selection criteria. 

Most forms emphasize the presence of a par- 
ticular factor rather than its quality. That is, 
there often are descriptions of what the criterion 
refers to, but there is no discussion of what dif- 
ferentiates quality in the way that factor is pre- 
sented. 

Committees seem to give equal emphasis to all 
the factors included on the criteria sheet. Raters 
are sometimes directed to evaluate texts by as- 
signing a number for each of the factors on the 
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list. These numbers are then added together to 
give a total evaluation for the text. 

The number of criteria on any one sheet is over- 
whelming. The longest criteria sheet included 
180 items and the shortest included 42, for an 
average of 73 factors. 

A doctoral study at Indiana University 8 pro- 
vides additional insight into the decision-making 
processes of local adoption committees. Although 
it is not clear which factors had the most influ- 
ence on decision-making, the study found five 
general factors that influenced committee mem- 
bers' decisions: 

• Publishers— the quality of publishers' pres- 
entations; the personalities of the represen- 
tatives; the order in which publishers make 
their presentations to the committee; and, 
the reputation of each publishing company. 

• Pilot try-outs— • the reputations of the teachers 
who piloted the programs; the length and 
extent of the pilot study; and the publishers' 
services to the pilot teachers. 



Perhaps the most important factor for policy- 
makers to consider is the state adoption versus 
nonadoption issue. Large adoption states exert a 
strong influence on textbooks. Whether it is 
accepted or not, the books that these states 
demand are the books that the smaller and 
nonadoption states get. 



• Politics— the personalities of the people on 
the adoption committee; the books that were 
selected in nearby schools; attempts at com- 
promise to get one book acceptable to every- 
one; and the interrelationships of the people 
on the committee. 

• Processes— the amount of time committee 
members were able to devote to the process; 
other obligations of committee members; the 
particular organization of the committee; the 
organization of criteria sheets used; and the 
procedures developed to allow textbook pub- 
lisherp to make presentations. 

• Pedagogy— educational trends and local is- 
sues; the strength of the program as viewed 
by primary-grade teachers; the committee 
members' experiences and attitudes with pre- 
vious reading textbooks; and each commit- 
tee members' beliefs about teaching reading. 

This study reveals that the textbook process 
is complicated, and solutions aimed at improv- 
ing the process must recognize that complexity. 



How Can Textbook Selection 
Be Improved? 

Perhaps the most important factor for policy- 
makers to consider is the state adoption versus 
nonadoption issue. Large adoption states exert 
a strong influence on textbooks. Whether it is 
accepted or not, the books that these states de- 
mand are the books that the smaller and non- 
adoption states get. The influence of the adop- 
tion states does provide a lever for changing 
textbooks, but that influence probably results in 
greater textbook homogeneity. 

Consequently, it is easy to discover what the 
key issues in any state are by examining the 
advertising campaigns of publishers. For exam- 
ple, California, in its new language arts frame- 
work, has emphasized that basal reading pro- 
grams must include quality literature. When the 
new (or at least revised) basal reading programs 
are presented to the California adoption commit- 
tee, each publisher will emphasize the quality 
of its literature; each will claim to have more 
award-winning stories than the other; each will 
argue that it has the best-known and favorite 
children's stories and authors; and each will look 
alike! 

About half the states are adoption states and 
half are nonadoption states. Policymakers in 
most adoption states are convinced their policy 
is best and fear they cannot control the curric- 
ulum if they do not control the textbooks. Most 
policymakers in nonadootion states believe the 

election of textbooks h oest made at the local 
school district level. Because of these fundamen- 
tal differences, it is unlikely that we will ever 
see a uniform policy across states. 

However, it seems if a uniform policy were 
adopted, the policy should recommend that selec- 
tion be left to the individual school districts for 
the following reasons: 

• Elevating textbook selection to the state level 
makes it tantamount to curriculum selec- 
tion. 

• Textbook selection at the state level increases 
the likelihood that national political forces 
will use the process to draw attention to their 
issues— often with little regard for improv- 
ing education. 

• The backgrounds and experiences of children 
differ dramatically in different parts of each 
state. Thus, local educators should be allowed 
to determine which books best meet the needs 
of their students. 

• Local educators are as w^ll qualified to re- 
view and select textbooks as those selected 
for state committees. 
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• Publishers will be more apt to produce new 
books with varying perspectives if they do 
not have to rely on success in the adoption 
states. 

In addition to the concern with state adoption/ 
nonadoption, a number of issues should be con- 
sidered when textbook adoption processes are 
studied: 

• Specific criteria should be developed before 
textbooks are examined. These criteria should 
relate to what a textbook can do— and not 
what is needed in a total curriculum. 

• Textbooks should be tested in short, controlled 
pilot studies in which a teacher tries out at 
least two different books. 

• Those who review the textbooks should be 
provided with adequate background in ex- 
amining books. Furthermore, they should be 
given enough time to do a thorough review 
of each textbook. 

• Sampling techniques should be developed to 
give adequate attention to topics. When a 
reviewer tries to look at everything, there 
is often only time enough to "flip through" 
the materials. 

• Specific evidence to support the reasons for 
selecting a particular textbook must be pro- 
vided by each reviewer. 
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Who Is 

Accountable for 
Thoughtfulness? 



According to one definition, thoughtfidness is 
'characterized by carefid, reasoned thinking. 9 
Mr. Brown suggests that many schools provide 
too few incentives for thoughtfidness and too 
many incentives for just getting by. By holding 
schools accountable for minimal levels of 
achievement, we encourage them to deliver 
just that. 



BY REXFORD BROWN 



TWO QUITE different char- 
acteristics are suggested by 
the word thoughtfidness: ab- 
sorbed in thought, medita- 
tive, "characterized by care- 
ful, reasoned thinking*; or considerate 
of others, selflessly concerned with Ac 
needs of others. Today's students are of- 
ten criticized for lacking thoughtfulness 
in both senses of the word. Although 
proposals abound both to make students 
better thinkers and to make them more 
mindful of others, in this article I will 
focus on ways in which administrative 
structures and assessment procedures can 
reward or discourage the development of 
students' reasoning powers. 

Concern about students* thinking is 
not new. though it has waxed and 
waned. The current fascination has two 
distinctive features: it is driven by the 
anxiety of business and industry to re- 
main competitive in world markets, and 
it extends to all students, not just the 
college-bound elite. 

REXFORD BROWN is director of Policy 
and the Higher Literacies, a project of the 
Education Commission of the States. Den- 
ver. 



In the past, educators pushed thought- 
fulness, while the business community 
seemed more interested in basic skills. 
Today we find business leaders deplor- 
ing the schools 1 overemphasis on the 
basics because they see a changing econ- 
omy that will require more creativity 
and judgment on the part of workers, i 
Interest in quality circles, in getting 
extraordinary performance out of ordi- 
nary people, and in letting those closest 
to problems help solve them has focused 
attention - at least for the moment - 
on the kind of thinking students learn 
in general, remedial, and vocational 
classes. It is assumed (perhaps errone- 
ously) that students in higher tracks are 
already being challenged to think, to 
solve problems, and to work collabora- 
tively with others. 

Certainly the enthusiasm for carrying 
education for thoughtfulness to all stu- 
dents is not universal. Some observers 
foresee a future that will call for even 
less thinking in the workplace and that 
will offer even fewer jobs that require 
the exercise of intelligence. What is im- 
portant, though, is that the debate over 
this issue has been joined and is grow- 
ing more intense. Americans do not like 
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to be behind in anything, and they do 
not like d see declines. They are not 
happy that their students trail those of 
other countries, and they are particu- 
larly distressed that the higher-order 
thinking skills of U.S. students appear 
to be declining. 2 The popularity of such 
books as Cultural Literacy, by E. D. 
Hirsch, and Vie Closing of the Ameri- 
can Mind* by Ailan Bloom, attests to a 
widespread concern about educational 
matters that go far beyond fhe basics.^ 
The question we must ask is, Can 
schools as we know them become mo;c 
thoughtful places and produce students 
who are themselves more thoughtful? 
Ignoring the prior questions of wheth- 
er all parents want their children to be 
more thoughtful or whether the students 
themselves want to be more thoughtful, 
we must ask whether the current struc- 
ture of schooling and the current web of 
incentives and disincentives would be 
likely to encourage thoughtfulness.. 

Observational studies of schools sug- 
gest that in many of them very little 
reading for comprehension goes on, that 
veiy little significant writing is done, 
that very little discussion occurs, and 
that veiy little meaningful questioning 
or Socratic dialogue takes place/ Most 
people would agree that all these activi- 
ties couJd be called thought-inducing. 

But in real schools textbooks domi- 
nate reading materials, and textbooks 
are commonly attacked for their im- 
poverished prose, incoherent structure, 
and one-dimensional view of the world. 
Teachers tend to talk too much and to 
control classroom events, relegating stu- 
dents to primarily passive roles. Teacher- 
made tests tend to concentrate on re- 
call of facts and terms and to require 
filling in blanks or, at most, writing 
short answers. Standardized tests are 
typically made up of multiple-choice 
items that do not call for much in the 
way of analysis, synthesis, inteipreta- 
tion, evaluation, or open-ended problem 
solving. State and district tests tend to 
focus on basic skills, 5 state and district 
policies tend to stress minimum com- 
petencies, and public debate still tends 
to revolve around the "basics" that the 
schools have somehow left behind and to 
which they must somehow return: 

These tendencies do not bode well for 
proponents of more thoughtfulness. In- 
deed, some advocates of thoughtfulness 
have given up on the schools entirely 
and have suggested that communities 
foster thoughtfulness through the pro- 



grams of children's museums and histor- 
ical societies. 6 

It is especially easy to become dis- 
couraged about changing our less-suc- 
cessful schools. Everything that hap- 
pens in them is "overdetermined." That 
is. there are simply so many reasons 
why something is done in a particular 
way that no single reason to change is 
sufficient. If teaching grammar as a way 
to improve writing satisfies a dozen per- 
sonal and institutional agendas, research 
evidence that explicit grammar instruc- 
tion has no effect on students' writing 
ability will not change the school's prac- 
tice. If we are going to improve schools, 
we need to know much more about why 
they are the way they are. 



ONE REASONABLE hypothe- 
sis to explain why so many 
schools are inhospitable to 
thoughtfulness is that there 
are too few incentives for thoughtful- 
ness and too many incentives for just 
getting by. Certainly the observations 
of Eleanor Farrar, Arthur Powell, and 
David Cohen about the •'shopping mall 
high school" provide evidence to sup- 
port this hypothesis. 7 When it comes to 
schools, we get pretty much what we 
ask for; by holding schools accountable 
for minimal levels of achievement, we 
encourage them to deliver just that. 
What would happen if we held them 
strictly accountable for more? 

Of course, there are many reasons 
why we don't hold schools strictly ac- 
countable for teaching mora than the 
basics. For one thing, many of us be- 
lieve that the majority of students do not 
particularly want to be in school and in 
any case are not blessed with the talent 
it takes to excel. It would be silly of us 
and harmful to such students, we rea- 
son, to ask more of them than they can 
deliver. So we measure their mental ca- 
pacity, assign them to classes with their 
intellectual peers, and persuade our- 
selves that we have done enough. 

Then, too, many of us are captivated 
by theories of teaching and learning that 
tell us to break knowledge into discrete 
pieces and to teach and test these pieces 
one by one, starting with the simplest 
elements. We then find that knowledge 
can be broken into so many pieces that 
we wind up spending all our time cover- 
ing the simple elements and never get to 
the more complicated stuff, try though 
we may. Many of us have also noticed 



Everyone is 
ultimately held 
accountable for 
the same thing: 
student achievement, 
as measured 
by tests of 
basic skills. 



that it is easier to develop tests if we 
ask questions about these basic elements 
than if we ask students to write or talk 
about more complicated matters. Psy- 
chometric "science" has been very help- 
ful in this regard by showing that suc- 
cess on very elemental test items corre- 
lates with success on more complicated 
endeavors. Thus we are freed from the 
burden of designing tests of more com- 
plicated tasks. 

Finally, many of us undoubtedly fear 
thoughtftilness because it cannot be eas- 
ily controlled. Too much of it, and sud- 
denly we've lost track of time, haven't 
covered the required material, or face 
questions that we cannot - or do not 
wish to — answer. 

No doubt another reason we attend so 
faithfully to minimums and basics is that 
state and local policy makers hold us 
strictly accountable for them. It is the 
policy makers' job to establish minimum 
standards in housing, health matters, 
prison conditions, building codes, and so 
forth. We all benefit from the enforce- 
ment of such standards, and it is per- 
fectly reasonable for policy makers to 
establish and monitor minimum standards 
for education, as well. 

The problem with a policy that is 
minimum-oriented, however, is that it 
requires a free market or some other 
such device to push it toward excel * 
lence. Take health codes in the restau- 
rant business, for example. The govern- 
ment sees to it that standards that mini- 
mize the number of rats in restaurant 
kitchens are enforced, and this greatly 
boosts my confidence in dining out. But 
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the government need not do very much 
to promote excellence, because restau- 
rant critics, Michelin guides, culinary 
awards, and the incentives and disincen- 
tives of the marketplace serve to pro- 
mote excellence and run mediocrity out 
of business. 

Education policy has been strong on 
enforcing minimums, but it has had no 
system of comparable strength to push 
for maximums. We have relied on rhet- 
oric, pride, subsidies, and the pressure 
of test scores as the primary tools for 
promoting excellence. Rhetoric is very 
important for establishing a climate that 
is conducive to excellence, but it can 
only go so far. Pride is a wonderful 
thing to count on, but it weakens quick- 
ly in bureaucratic settings and sooner 
or later needs tangible support. Sub- 
sidies have certainly brought a number 
of innovations into the schools and re- 
main a formidable means of making 
things happen, but subsidies are sub- 
ject to the whims of politics and are not 
dependable. The pressure exerted by test 
scores — linked as it is to ample rheto- 
ric, community pride, and some subsi- 
dies - has become the primary policy- 
making mechanism for pushing less- 
successful schools toward higher levels 
of achievement. This is a natural exten- 
sion of a mechanism that has worked 
pretty well for minimums, but it is 
fraught with problems when thoughtful- 
ness is the goal. 

ThoughtfUlness requires close reading 
and disciplined debate about what has 
been read. It requires substantial writ- 
ing — not just narrative writing but ar- 



gumentative, analytical, and evaluative 
writing that is then closely read, dis- 
cussed, and rewritten. Thoughtfulness 
requires a great deal of time devoted to 
discussion - not just any discussion, 
but disciplined, Socratic dialogue. And 
thoughtfilness requires an open-ended- 
ness that few teachers dare encourage, 
because they would have to ask ques- 
tions to which no one knows the answer 
or present problems to which there may 
be many possible solutions. Activities 
such as these can neither be promoted 
nor assessed with the conventional stan- 
dardized, multiple-choice, machine-scor- 
abie tests that are used across the coun- 
try for "policy-based teiting." 

Conventional policy-based testing — 
that is, testing in order to make policy 
decisions, monitor the effects of those 
decisions, track different groups of chil- 
dren, or insure that minimum standards 
are met - is the wrong kind of account- 
ability tool for thoughtfulness. It makes 
people accountable only for the devel- 
opment of very low levels of knowledge 
and skill. Good schools and teachers 
tend not to pay much attention to these 
tests. As long as they are performing 
well, they feel free to experiment with 
more challenging modes of education. 

But insecure teachers and schools un- 
der pressure to raise achievement lev- 
els blatantly teach to the test*. Since the 
tests require little thoughtfulness, the in- 
struction and curriculum that revolve 
around them remain stuck at a very ba- 
sic level. Under such circumstances, 
the demands of accountability intryde 
on teaching and learning time and warp 




"Mr. Hoyt is teaching an inservice course to substitute teachers. m 



instruction in ways that may often raise 
test scores even as they lower the quali- 
ty of the education being delivered. 



IF POLICY MAKERS are serious 
about wanting more thoughtfulness 
in the schools, they are going to 
have to help develop a different 
kind of system of accountability - one 
that promotes, assesses, and rewards 
constant change in the direction of 
greater thoughtfulness. Such states as 
Connecticut, California, Pennsylvania, 
and Michigan have already embarked 
on efforts to create assessments of criti- 
cal thinking, more sophisticated writing 
skills, and higher-order thinking skills 
in science, mathematics, and reading. 
Some districts, such as Cincinnati, Pitts- 
burgh, and Shoreham-Wading River 
(New York), have been trying to create 
assessments of thinking skills in vari- 
ous subject areas, in the hope that new 
kinds of tests will force new kinds of 
teaching. These are promising starts 
(though I would distinguish "thinking 
skills** from thoughtfulness), but they 
still leave us a long way from our goal. 

Several barriers to the development 
of a different system of accountability 
loom large. To begin with, an accounta- 
bility system for thoughtfiilness will re- 
quire widespread acceptance of descrip- 
tions of education that differ from those 
we now have. The images and meta- 
phors we use to describe education will 
have to change. The system of instruc- 
tion and the tests used to evaluate it, 
arising from the same view of teaching 
and learning, must chants. Standard- 
ized, multiple-choice, norm-referenced, 
machine-scorable tests belong to a sys- 
tem of education that is managed in terms 
of goals, objectives, subobjectives, and 
statements of outcomes — a system that 
breaks the day into minuscule bits of 
time; that breaks the curriculum into 
thousands of tiny units to be taught and 
tested one at a time; that structures in- 
struction to match the bell-shaped curve 
that lies behind norm-referenced tests; 
and that requires uniformly teaching and 
testing large groups of students. If we 
want an accountability system that will 
gather data for maintaining minimum* 
standards without thwarting constructive 
growth and change, we will have to re- 
design the existing system. 

Such wholesale restructuring has hap- 
pened before. Testing as we know it to- 
day became a pan of schooling at a time 
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when great demands were being placed 
on the educational system to absorb 
large numbers of people who had not 
previously sought schooling. A national 
need to sort people and a desire to do so 
"objectively" ran head-on into the Ions- 
established practice of "subjective" eval- 
uation. Slowly but surely, subjectivity 
was driven to the margins. It did not fit 
the more modern, "scientific" concept 
of education, and it did not serve the 
needs of public policy at that time. Sub- 
jective evaluation was looked on as irra- 
tional, inefficient, inacearate, and in- 
adequate. Something similar - though 
perhaps less extreme - must happen to 
the current system of accountably if 
we are to make room for a more chal- 
lenging and productive one. 

A second obstacle to creating greater 
accountability for thoughtfulness is that 
the current approach is widely believed 
to serve bureaucratic and public rela- 
tions needs. Whether or not it does so 
remains open to question, since there is 
evidence that those in the bureaucracy 
who might be expected to use test data 
may not be "doing so. 1 In complex or- 
ganizations, few decisions are made on 
the basis of any single indicator; in- 
stead, people tend to cite test data when 
they serve to confirm judgments and ig- 
nore them when they don't. But it is 
clear that standardized test data describe 
performance in a way that is easy for the 
public to grasp. This certainly serves the 
district well when the test scores are high 
or rising. 




"What a day! The computers went 
down, and then so did the teachers. * 



Anyone who wishes to create an ac- 
countability system for thoughtfulness 
that will be as potent as the current sys- 
tem of accountability for basic achieve- 
ment must come up with measures that 
are as simple and as easy to understand 
as test scores and that appear to be use- 
ful to the bureaucracy. This is a formi- 
dable challenge on both counts. Advo- 
cates of thoughtfulness are likely to push 
for multiple indicators of quality, while 
the bureaucracy and the public seem to 
prefer single, quantitative indicators. 
If the fight to replace standardized, 
multiple-choice tests of grammar and 
usage with writing samples is any gauge, 
then the battle to install more robust 
indicators will be long and hard-fought. 

Advocates of thoughtfulness will also 
have to unscramble the current confu- 
sion about who is responsible for what. 
Tpday, the only people who can honest- 
ly take responsibility for test scores are 
the students themselves. Their teachers 
will not do so because they do not wish 
to be held responsible for what the stu- 
dents' homes might have done to influ- 
ence achievement or for what the stu- 
dents' previous teachers might have done. 
Principals say that they should be held ac- 
countable for their performance as lead- 
ers and managers, not for the achieve- 
ment of students they never face. School 
boards and superintendents say that they 
should be held accountable for the leader- 
ship and management tasks they were 
elected or aired to cany out. Yet every- 
one is ultimately held accountable for 
the same thing: student achievement, as 
measured by tests of basic skills. 

This overuse of a single indicator en- 
ables some people to escape responsi- 
bility for poor job performance while 
others are denied praise for jobs well 
done under difficult circumstances. 
Moreover, it encourages people to be- 
lieve that thiir job is to manipulate 
someone else into doing his or her job 
bene;, and so everyone winds up mind- 
ing the business of everyone lower down 
in the hierarchy, and the entire weight 
of the bureaucracy falls on the teachers. 

As formidable as these obstacles to in- 
stalling a more robust system of account- 
ability may be, they ajc notjnsuperable. 
A new vision of education is taking shape 
under the combined pressures of new 
economic forces and of old promises as 
yet unkept. Bureaucracies can and do 
change when their accumulated irration- 
alities render them unable to respond to 
public needs. Public opinion about what 



constitutes a valid measure of academic 
performance has changed in the past, and 
it will change again. 

The best way to restore balance to 
a system that is too heavily tilted to- 
ward the basics would be to create a 
strong counterculture within the system 
that values inquiry and thoughtfulness 
above all else. Bureaucratic values and 
modes of operation tend to move into ter- 
ritory someone has abandoned or not yet 
claimed. Since we have not yet made a 
strong commitment to the proposition 
that all students can learn - and can 
learn a great deal more than they do to- 
day - we do not really know what our 
educational system can do. To the ex- 
tent that we show i; to be capable of do- 
ing much more than it now does, we 
will be held accountable for much more. 
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Higher and Deeper 
literacies : 



Toward More Thoughtful Schools and Students 



by Rexford Brown 



REXFORD BROWN is director. Policy and 
Higher Literacies, a project of the 
Education Commission of the States, 
Denver. Colorado. 



It is not yet an educational 
••movement'* because its adherents 
are marching under too many banners. 
It doesn't have a name or a slogan, and 
its argument has yet to be made as 
forceful and as compelling as it one 
day will. But there is something like a 
movement taking shape as people try to 
explain why the first wave of 
educational reforms must be superseded 
by a more thorough transformation of 
schooling in America. The common 
thread that runs through critique after 
critique is that this country needs to 
develop much higher levels of literacy 
in a broader range of students than ever 
before in American history. And that 
word literacy is being stretched to 
include such things as thinking skills, 
problem solving skills, critical 
thinking, higher order thinking :kiiis. 
advanced reading, writing, speaking, 
and listening skills, dispositions and 
attitudes, collaborative skills, 
commitment to democratic values, 
knowledge about how to kesp learning, 
and knowledge about such subjects as 
scie.ice, computers, civics, and the 
culture at large. 

We've come a long way from our 
grandparents' definition of literacy as 
the ability to write one's name. We are 



even moving quickly beyond definitions 
cf literacy that sufficed only a decade 
ago. Possession of a sixth-grade 
education or of the "basics" or even 
of a high school or college diploma is 
no longer a sufficient indicator of the 
knowledge, skills, and attitudes many 
think will be necessary for the pursuit 
of public and private happiness and 
welfare in the 21st century. 

At the Education Commission of the 
States, we have tried to put all these 
expanded definitions of literacy under 
the vague umbrella "higher literacies." 
Some have suggested that "deeper 
literacies" would be more accurate. 
The important point is that, in one way 
or another, what many governors, 
easiness leaders, economists. labor 
leaders, policy makers, and educators 
are saying is that they want to see more 
thoughtful students — thoughtful in the 
sense of reasoning better, better 
disposed to prefer thoughtful solutions 
to problems, and more caring about 
others and about their communities. 
Literacy, which used id denote a 
relationship with text, now refers to a 
quality of mind, a mode of engagement 
with the world that begins with text but 
goes far beyond it. Increasingly, this 
expanded notion of literacy is seen as a 
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goal for all students, not just the 
college bound. 

This expansion of the meaning of 
literacy and the broadening of the 
population for which it is applicable 
portends profound changes in 
schooling. Observational studies of 
schools over the last decade make it 
painfully clear that too many schools 
are not very thoughtful places nor are 
they environmentally conducive to the 
kinds of literacy we are talking about. 
Research has established that in most 
schools very little reading, writing or 
discussion takes place; we have asked 
for something very basic and we are 
getting something very basic. The 
question is: Can we get a higher or 
deeper or expanued kind of literacy 
from the current system? 

The argument that we cannot rests on 
the assumption that we have 
institutionalized a number of beliefs 
about literacy, teaching, and learning 
that militate against any significant 
change. We have institutionalized the 
belief that LQ. determines students* 
learning limits; that most young people 
do not particularly want to learn much 
and do not possess the intelligence to 
.pursue more demanding studies; that 
reading and writing have more to do 
with decoding, encoding, and sounding 
out than they do with creating meaning, 
inquiring or constructing models of the 
world to aid our understanding of it; 
that we will never be able to afford 
truly individualized learning and will 
have to accept the limits of mass 
education — the transmission mo<H of 
instruction with its passive students and 
endlessly lecturing teachers, a tracking 
and sorting system, and so on. 

The assumption that these and other 
beliefs cannot be rooted out of the 
current system is unproven. it should 
be the primary focus of school literacy 
research for the next decade. 
Meanwhile, we can begin to try to 
understand the ways in which state and 
community policy have combined with 
educational theory to create and support 
the institutions we now have. State 
leaders interested in pursuing a second 
wave of reforms should be gathering 
evidence about the effects of the first 
wave. We need to know more about the 
effects of curricular mandates on a 
curriculum that is already too broad 
and too shallow. Can we promote 
thoughtfulness when teachers are 
anxious about "coverage*'? 

-Weneed-toknow-moreaboutthe 
effects of standardized multiple-choice 
tests. Do they signal an interest in 
thoughtfulness. or do they tell teacher 
and student alike that drill and rote 
learning take priority? Does our interest 



in insuring minimum levels of 
performance crowd out time to aim for 
maximums? 

We need to know whether recent 
interest in better teacher training and 
higher certification requirements will 
bring us teachers who are better skilled 
at providing students with the kinds of 
open-ended activities that lead to 
thoughtfulness. And we need to know 
whether the ways money flows through 
the system encourage or discourage 
innovations that could lead to more 
thoughtfulness. 

if policy makers want more 
thoughtful students, they will have to 
see to it that someone is accountable 
for thoughtfulness, that there is a 
curriculum for thoughtfulness, that 
thoughtfulness is evaluated 
appropriately, that teachers have the 
time and environment to be thoughtful 
themselves, and that there are ample 
incentives for thoughtfulness. 
Meanwhile, teachers, researchers, and 
others would do well to build a strong, 
coherent argument and find fewer 
banners under which to marvd. They 
need a constituency for thoughtfulness 
as powerful as current constituencies 
for equity or for the basics. They need 
a conceptual approach that includes 
attention to equity and to basic skills as 
well. They need to dramatize 
relentlessly the differences between 
what more and more people say they 
want out of schools and what schools 
are less and less likely to produce in 
their present fonn and with current 
policy. They need to highlight 
dysfunctions in the current system: 
Lecturing will not get us there; a 
fragmented, incoherent curriculum 
won't get us there; student passivity 
won't get us there; decontextualized 
learning won't get us there; minimums- 
oriented policies won't get us there. 

Americans are practical people. 
When something is broken, they want 
to fix it. If the nation's needs have 
outstripped the marvelous educational 
institutions it created earlier in this 
century, then, as its dysfunctions 
become more and more .apparent, 
Americans will try to fix it. Efforts to 
fix the school system are well under 
way around the country. Good will and 
good intentions abound. Proponents of 
greater thoughtfulness must take 
advantage of reform momentum to 
point out that what needs fixing is not 
our capacity to transmit the relatively 
low levels oMiteracy-that-sufficed half 
a century ago. What needs fixing is our 
capacity to be thoughtful about 
preparing more thoughtful students for 
a world that will desperately need 
them. j<5j) 
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New policy dilemmas: 
Minimums versus visions 



Tests: 'serious limitations 
on educational possibilities 5 



by Rcxford Brown, ECS 



by Vito Perroae 



One of the great challenges 
facing policy makers over the next 
decade lies in balancing productively 
two major policy activities: those that 
address the need for minimum levels of 
achievement and competence in the 
schools and those that aim to raise 
dramatically the productivity of the 
schools. 

If both kinds of policy are not 
well harmonized, mini mums-oriented 
policies may well conflict with or even 
torpedo loftier policy aspirations. 

Both Policies Needed 

The need for both kinds of 
policy is obvious. Public institutions 
must be held accountable for at least 
minimal levels of quality; the public 
deserves them and fairness demands 
them. At the same time, policy has a 
visionary dimension. It should encour- 
age ever higher standards, promote 
excellence and challenge people and 
institutions constantly to improve. 

In many fields, government's 
role is restricted to just the minimums, 
leaving vision and incentives to free 
market forces. In health, for instance, 
government action can minimize the 
number of rats in restaurant kitchens, 
leaving the Michel in Guide and other 
such incentives to inspire restaurateurs 
toward five-star performance. There is 
a balance. 




Education does not take place 
in a free market. Educational 
minimums can be specified in politically 
manageable terms, and they can be 
measured. Maximums, however, defy 
consensus, and school policy is seen as 
weighted toward minimums. "Sure 
they talk about excellence," school 
people say, "but the rules and regula- 
tions and tests have nothing to do with 
excellence! They're ail about minimum 
performance. * The danger in such a 
system is that people will respond to the 
most concrete and direct policy influ- 
ences on their lives, not to rhetoric: 
They will tend to perform minimally. 
Where little is expected, little will be 
found. 

Of course, where schools are 
like restaurants with rats in the kitchen, 
minimums can improve performance. 
Even in schools a cut above the worst, 
the pressure and conversation about 
standards can trigger successful efforts 
to improve performance. But in most 
school? where performance is sluggish , 
minimums are beside the pint. The 
danger is that too much attention to 
minimum requirements may depress 
energies and expectations. 

There is some evidence and a 
lot of speculation that this has, in fact, 
happened in a number of places. Stu- 
dents have expected little of themselves. 
Teachers have expected little of stu- 
dents. Administrators have expected 
little of teachers, and the public has been 
satisfied with educational mediocrity. 

To the degree that this has 
happened — to the degree that 
minimums-orienied policies are part of 
the problem with educational perfor- 
mance — minimums are not going to 
be part of the solution. 

Far Higher Literacy Required 

The nation hv. entered upon a 
"second wave" of reforms calling not 
for more basics or for more minimal 
standards, but for much higher levels 
of literacy than ever. 

(continued on pzge S) 



I recently visited a school 
where the conflicts were enormous over 
the need to write individual education 
plans for children who scored below a 
certain point on the mandatory standar- 
dized tests. 

The involved special educator 
essentially took note of test areas in 
which particular children had not 
performed well. The prescription for 
each child was to devote time to those 
areas through direct instruction and 
focused skill sheets. Forone child, the 
problem was syllabication. 

The principal and the related 
teachers were contesting the entire 
procedure, but particularly the pre- 
scription. From their perspective, the 
fart that a child didn't know something, 
or how to do something in relation to a 
paper/pencil test, ought to bring forth 
a hypothesis where the results on the 
test could be corroborated in many more 
direct ways. They argued that syllabica- 
tion had little connection to reading and 
that the child would be served better by 
opportunities to hear more language, to 
do more writing, to be read to, to find 
books closer to his or her natural incli- 
nations than by any di rect effort around 
syllabication. 

While acknowledging that the 
prescribed exercises might improve the 
child's test score . . . , they believed 
such growth would likely leave the child 
in a worse place in relation to the overall 
goal of language competence. It is the 
kind of debate that is distracting teachers 
in that school and is not doing children 
very much good. 

Testing Versus Goals 

This happened in a remarkable 
school, serving mostly poor minority 
children extremely well. It is a school, 
however, in which the district's testing 
programs — reading tests, general 



achievement tests and locally developed 
curriculum tests — conflict with virtu- 
ally all of the educational norms those 
in the school seek to foster. The tests 
have considerable power — scores are 
in the newspaper, and the district has 
made particular levels of gain on the 
tests a measure of its success, giving 
suggestions that higher scores de- 
monstrate the schools are "effective," 
"turning around" and "getting better." 

In the face of the increasing 
power of the tests, those in this school 
have found their own evaluation efforts 
being diminished. 

This school is further 
exemplified by the thoughtful ness of its 
teachers and adminis;rators in regard to 
evaluation issues. They protested a year 
ago the new citywide science test, 
arguing that it covered too much ground 
too superficially and didn't get close to 
wha: children actually knew and under- 
stood. Further, and as importantly, 
they contended that it didn't honor their 
slower, more intense, meaning-t. taking, 
hands-on, observational ipproach to 
science teaching and learning. 

Ultimately , using the district's 
objectives and the questions asked on 
the districtwide multiple-choice test, 
they devised an alternative test — a pilot 
study in science assessment. Almost 
everyone who examined the alternative 
assessment instrument liked it. But it 
hasn't replaced the citywide test. 

Protesting the Test 

The way the teachers and 
administrators approached the issue is 
reflected in the following background 
statement they included in the descrip- 
tion of the alternative process: 

(continued on page S) 
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Policy dilemmas 

(continued from page 4) 

The argument for higher 
literacies was made most recently and 
most forcefully by the Carnegie Forum 
on Education and the Economy, which 
pointed out that basic skills and literacies 
appropriate for the routinized work of 
early 20th Century mass production are 
no longer sufficient. 

The forum's report, A Nation 
Prepared: Teachers for the 2 1st Cen- 
tury, calls for "ability to reason and 
perform complex nonroutint intellec- 
tual tasks. . . "people with an ability 
to see patterns of meaning when others 
see only confusion. . . people with 
a "cultivated creativity. . . people 
who know how to learn all the time and 
are imbued moreover "with a set of 
values that enable them to use their 
skills in the service of the highest goals 
of larger society." The schools, the 
Carnegie report asserts, "must graduate 
the vast majority of their students with 
achievement levels long thought possi- 
ble for only the privileged few.** This 
is a tail order. Fewer and fewer students 
have been exhibiting these higher 
literacy skills over the last decade, 
partly because schools have focused 
intently upon basics. Nor will the trend 
be easy to turn around. 

Few classrooms are conducive 
to training in and practice of higher- 
order thinking skills. Teachers out-talk 
entire classroomsof students by a ratio 
ofl2to I; extended discussion, writing 
and rewriting, debate and all of the 
many ways in which students might 
develop more sophisticated information 
processing skills are rare. When John 
Goodlad studied the matter, he found 
thac even teachers who wanted toculti- 
vate sur u skills in their students either 
did not Know how or found themselves 
constrained by the structural conditions 
of teaching. 

The higher literacies challenge 
requires policy makers to examine the 
full range of policy tools that have been 
used to promote education reform, to 
weed out mini mums-based policies and 
programs that are barriers to progress 
toward much higher levels of literacy 
for much greater numbers of soidents 
and to invent "Michelin guide" policies 
that restore a proper balance of 
minimums and vision. 

Testing and Accountability 

The challenge poses some 
serious dilemmas for state and district 
testing programs. To begin with, if 
higher literacies instruction calls for 
more active learning, more critical 




thinking, more problem solving, more 
reading and discussion and extended 
writing, then it is clear that schools 
cannot assess these higher-order ac- 
tivities with the current standardized 
multiple-choice norm-referenced com- 
mercial tests so widely used to evaluate 
progress in the schools. The instruments 
used for accountability do not match the 
likely outcomes and forms of higher 
literacy instruction. 

A second difficulty lies in the 
influence of testing on teaching. To the 
extent thu the results of commercial, 
standardized tests are used to put pres- 
sure on schools, both teaching and 
curriculum tend to emphasize what can 
be tested in these simple formats. A 
learning environment centering around 
success on multiple-choi< e tests is not a 
learning environment conducive to 
instruction in higher literacies. The 
instruments of accountability do not 
match the teaching and curriculum 
necessary for higher literacies instruc- 
tion. 

Because of these and other 
potential problems, everyone interested 



in developing much higher ievels of 
literacy in the classroom should ask 
about their accountability programs: 

• Dotestsand accountability demands 
Intrude unduly on Utching and 
learning timer 

Do they promote "teaching to the 
test," narrowing emphasis to what 
can be tested quickly and inexpen- 
sively? 

' Are testing z.id accountability data 
really used in ways that promote 
better learning? 

Do commercial, standardized, norm- 
referenced tests serve as models for 
teacher tests? If so, are they the right 
models for teachers aiming to pro- 
mote higher literacies? 

Do current tests really match what 
teachers are trying to do in the 
classroom and what reformers believe 
will be required in tomorrow's 
classroom? 

Do testing and accountability data 
measure the most important things 



to know about schools' during a 
period of intense change and innova- 
tion? 

• Do accountability measures leave 
room for classroom, rchool or district 
experimentation? 

There are grounds for believ- 
ing that in many school systems the 
answers to these questions wiil be 
discouraging to anyone who wants to see 
higher literacies instruction flourish. 
Moreover, there is reason to fear that 
the sit> ition will worsen with every 
advance toward greater individualiza- 
tion of diagnosis, instruction and learn- 
ing. 

The Alternatives 

What, then, is a policy maker 
to do? Districts and states need a certain 
amount of data with which to evaluate 
education and make management deci- 
sions. The information should be 
uniform enough to permit evaluations 
across different systems and schools and 
it should not be unreasonably expensive. 
If current testing procedures are under- 
cutting higher literacies goals, are 
schools left with no alternatives but 
extremely costly assessments and/or a 
return to a chaos of subjective tests that 
could never be aggregated for policy 
and management decisions? 

There are several ways out of 
this dilemma. All require somewhat 
different assumptions rbout teaching 
and testing and learning and accounta- 
bility. Some interesting ones: 

• Move to a different set of indicators 
about student and school progress 

* Develop higher-order lite racy assess- 
ments 

Help teachers and districts to develop 
appropriate evalu"..on tools as they 
develop higher literacies curricula 

' Develop accountability indicators for 
ciassrooms, schools, districts, the 
state and the public at large, each 
system appropriate to the audience 
and what it needs to do to do its job 
well 

I n coming issues of the Leader 
and in a series of publications stemming 
from the ECS Higher Literacies 
Project, funded by the John D. and 
Catherine T. Mac Arthur Foundation, 
we will pursue these questions and 
describe efforts around the country to 
resolve these policy dilemmas. 



Rcxford Brown is ECS director of 
communications snd director of the 
ECS Higher Literacies Project. # 
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Higher literacy requires 
major school changes 

by Rexford Brown 



School reform that will bring 
sbout much higher levelsof literacy for 
more students will require major 
chrngesin schooling, a group of distin- 
guished scholars and policy makers 
com luded at an ECS summer institute. 

Meeting at the Aspen Institute 
for Humanistic Studies in Aspen, 
Coloradi). as|wrt of the KCS project on 
Polity 4ml the I ligher Literacies, 
participants expressed a wide range of 
hopes and concerns about state and local 
policies ami how they might hinder or 
filter critic at change* in schooling. 

"We have got to be asking 
ourselves 'what for' throughout this 
pcritHl of change," said Donald ( jtavc* 
of the University of New Hampshire. 
" I f wc lose sight of why we're t ryi ng to 
develop more thought fulness in more 
students, wc lose the whole bail game. 
These schools t hat a re focusing ai 1 1 hci r 
energies on just raiting test scores, and 
these schools that are adopting programs 
left and right, willy nilly, scare me. No 
one seems to be taking the time to adopt 
a long-term perspective and asking 
what it's all about." 

Participants had numerous 
points of view about the "whsl for" of 
school reform. 

• Far more students should be actively 
engaged in their learning. School 
environments encourage too much 
passivity and dependence in students, 
nuking it hard for young people to 
take responsibility for anything, 
including their educations. 

• Students must be relentless inquirers. 
School and classroom conditions 
must promote, sustain and reward 
inquir) . 

• All students — not just a privileged 
few — must be better at finding, 
defining and solving problems, not 
just as individuals but as members of 
groups and communities. 

• All students must be better at think* 
ing, thinking about thinking, reason* 



ing, defining the underlying values 
and assumptions behind ideas and 
statements, problem solving and 
other higher-order thinking skills. 
This means that schools must be 
places where children see this going 
on. Many schools arc not now condu- 
cive to thought fulness. 

• All studemi should Ik able to use 
literacy to understand themselves, 
the social and economic conditions in 
which they live and the things they 
and their communities might do to 
improve their lot. 

Nancy 1 loffman of the Univer- 
sity of Massachusetts and I larvard 
University urged major changes in the 
way students are taught. "If you want 
more public-spirited young people, you 
give them public service opportunities," 
she said. "If you want them to know 
more about the new workplace de- 
mands, then you get them out into the 
workplace or bring it into the school; 
if you want them to think critically 
about this society when they're out of 
school, yott get >hem thinking critically 
about it while they're in school." 




We have got to be 
asking ourselves 'what 
for* throughout this 
period of change* I five 
lose sight of why wc re 
trying to develop more 
thought fulness in more 
students f we lose die 
whole bail game. 




Mixed messages 

Bella Rosenberg of the Amer- 
ican Federation of Teachers decried the 
mixed messages being received by 
middle-school teachers and principals. 
"On the one hand, they're being told to 
beef up the substance and get students 
ready for a more demanding high 
school curriculum," she said. "On the 
other hand, they're being told to down- 
play substance and attend to the emo- 
tional needsof early adolescence. Many 
middle schools have an agenda that's 
basically anti-intellectual." 

Current trends in testing and 
accountability worried a numl>cr of 
participants. "As long as states continue 
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to test low-order skills, teachers will 
continue to teach low-order skills more 
than they need to," said Judith linger 
of Stanford University, "The trick is to 
come up with affordable teststhat force 
everyone to do a lot more thinking." 



As long as states con' 
tinue to test tow-order 
skills, teachers will 
continue to teach low- 
order skills more titan 
they need to* 



I .anger cited a teacher who told 
her students to "invent an aninul" as a 
way to determine whether they under- 
stood organic systems. "These kindsof 
tests challenge kids and teachersalike," 
she said. "They have right and wrong 
components but they're open-ended at 
the same time." 

Guitele Nicolezu of the Associ- 
ation for Community Rased Kducation 
said that each school and community 
should take more responsibility for 
deciding what should I* tested. " There's 
nothing wrong with ics'-og per se," she 
said. "The issue is who will control the 
contents of the tests. Will it be people 
outsidethe community or people within 
the community?" 

UnJermininjfc teaching 

Matthew l.ipnnn, director of 
the Institute for the Advancement of 
Philosophy for Children, also expressed 
Concern about outside forces that de- 
prive teachers of responsibilities. "We 
have to preserve the quality of 
craftsmanship and apprenticeship in 
teaching," he said. "As more and more 
external instruments and agencies 
assume functions that teachers are l>c\t 
able to perform , we're undermining the 
profession in our very efforts to shore 
it up." 

Robert St.hu.irt7, director of 
education policy for Governor Michael 
Dukakis of Massachusetts, reminded 
the group of the importance of basic 
skills testing in large urlan districts. md 
said it is not going to go away for a long 
time. "If you want to change the ac- 
countability system, you'll ha"etodnit 
slowly and carefully," he said, "You'll 
really need to Mart a parallel one. When 
its usefulness is proven to policy ni ikers, 
they'll start paying attention to it." 

Another topic during the 
four-day conference was resistance to 
change. Michael Apple of the Univer- 
sity of Wisconsin asked participants to 
reflect on the people who are cited as 
"resist rs* in studio of school change. 
"The fact is that in any reform, the 
resistors outnumber everyone e'sc," he 
said. "Wc have to ask ourselves who 
these people are and what they are 
defending when they either resist or 
don't take an interest in change. I think 
w:"' find that most of them are defend- 
{ *lf 'rd*won gains in Control over their 
«t*»t time— things we don't want 
to see them lose, either." 

EHri . agenda? 

Other questions the group 
dc«*st 1 included whether or not a 
higher literacies agenda was elitist; 
whether thecurriculum hasshiftedtoo 
far toward an emphasis on process and 
too far away from considerations of 
content; how to improve the manage- 
ment of urban school districts; potential 
federal roles in promoting higher 
literacy for more students; ? 'he 
impact of state school improvement 
initiatives on higher literacies. 

The Politics of Literacy insti- 
tute was one of several planned for the 
KCS project. 'Ihe discussion, debate 
and recommendations wt\\ Ik woven 
into briefing materials <o be released 
this fall and a book to be released in the 
winter, 



flroM n direc ts the Policy and the I ligher 
Literacies project. • 
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Another endangered literacy 

Cultural Literacy, BJX llirsch Jr., Boston; Houghton Mifflin 
Company, 251 pp., $16.95 

6>- Rexford Brown 



With Cultural Literacy, K.I), 
llirsch Jr., a professor of Knglish at 
the University of Virginia, joins a 
swelling chorus of critics concerned 
about the curriculum in American 
schools. Persuaded that schooling has 
tlx ) long been dominated by a "content- 
neutral conception of educational de- 
velopment" that dates from the time of 
Rousseau, Hirsch calls strenuously for 
attention to content. 

"We have permitted school 
|M>licies that have shrunk the body of 
information that Americans share," he 
write*, "and these policies have caused 
our national lite ;»*y u decline. " 

Literacy has a lined, he 
(>elicves, kcause it dc«>Mds upon a 
shzred body of culture! Knowledge, a 
national vocabulary by which people 
can communicate alniut important 
matters. Americans do not share that 
knowledge or vocabulary, he asserts, 
Ik cause we have not taught it in our 
schools. 

"My father used to write 
business letters that alluded to Shakes- 
peare," he writes. "These allusions were 
effective for conveying complex mes- 
sages to his associates Ikc a use in his day 



business people could make some allu- 
sions with every expectation of l>cing 
understood." 

Not today. Because reading 
and writing have become "decoding" 
and "encoding" skills taught mechani- 
cally and with no relation to a core of 
cultural facts, ideas and values, students 
acquire a shallow kind of literacy. Tliey 
are not skilled at understanding r.iorc 
complex, mature material. 

The damage is particularly 
gre?t, Mirsch believes, for disadvan- 
taged students, who begin school already 
deprived of background knowledge 
al)out the larger culture. 

"Cultural literacy constitutes 
the only sure avenue of opportunity for 
disadvantaged childien, the only reli- 
able way of combating the social deter- 
minism that now condemns them to 
remain in the same social and educa- 
tional loi.ditio: as their piicni*,** 
I lirsch continues. 

What, exactly, Sis cultural 
literacy ami how might schools promote 
it? llirsch is very clear that it is fli'fa 
core curriculum. The elements of 
cultural literacy can I* gleaned from a 
wide variety of texts that have sha|wd 



the American consciousnessand created 
our national language. 

Because that language contains 
allusions to figurcsand events from the 
Bible, the Greeks, the Rom mis, the 
Renaissance, the Enlightenment, Amer- 
ican history or modem science, students 
need to know what the allusions mean 
when they come across them in their 
reading. Thisdocs not mean, however, 
that they must read particular honks. 
"Almost any battle will do to gain a 
coherent idea of battles," I lirsch writes. 
"Any Shakespeare play will do to gain 
a schematic conception of Shakespeare." 

The key to his approach — and 
one of the things that makes it contro- 
versial — is I lirsch's insistence that 
culturr 1 literacy consists not in knowing 
books, but in knowing key wc Js, 
names, dates, places, phrases, sayings 
and allusions that come from books. 

"It should energize people to 
learn that only a few hundred pages of 
information stand between the literate 
and the illiterate, between dependence 
and autonomy*" he writes. And then he 
provides a first draft of the list, about 
5,00(1 items, which he proposes Ik 
taught in school like vocabulary is 
commonly taught — through memori- 
zation, drill .nid pi.iiti<c. 

Siinc ileitis mi ilu |im ,n 
lophohia, AKC, Baltic ol Midway, Ji* 
I touis, "not with a king but a w himpvr," 
vulcanization. To those who w til sty 
such a list is dangerous :n the i\andsof 
educators, llirsch replies: "It's not the 
list that <s dangerous to serious educa- 
tion, ilsexplii ituess is dangerous to the 



inadequate, skills-oriented educational 
principles of the recent past." 

llirsch does policy makers a 
service by calling into question any 
curriculum that separates "skills" «— 
whether reading or writing or thinking 
— from substance. Students have to 
read ami write and think alxmt and with 
a kiHtwIctlgv o/' particulars. f| c makes 
an interesting case that in theory, at 
least, we can have cultural literacy and 
cultural pluralism at the same time, 
without resorting to Ixioklists that 
dominant social classes im|>ose on 
subdominant groups. Students can have 
distinct class and ethnic identities, yet 
all s|>eak the same language of our 
culture. I lis warning that school reform 
must sooner or later confront the issue 
of the amtcnts of literate education 
alerts us to the long row re formers have 
yet to hoe. 

On the other hand, |>olicy 
makers should l>c wary al>oiit I lirsch's 
proposed solutions, which are at once 
vague and simplistic. The last thing the 
reform movement needs is a round of 
state mandates for yet another kind of 
literacy 

I lirsch's theories should not l:e 
acted ti|niii. Thc\ should be debated 
nj! usK I lis lisi should mil br 

»« II himld f«»M< tiniioiiiiiilKs 

to.irgucMlMiitl what they share ami \\\ui 
they want their children to share. 



lit m\n /• CS <//m for <> t\ tmunxu nra- 
tmnsMuliliurtorot the / Wk yiuultlw 
I hgher t.ttvr.u'n"* hojti': # 
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